-- Logs begin at Mon 2022-09-26 09:50:57 UTC, end at Mon 2022-09-26 10:53:47 UTC. -- Sep 26 10:24:06.902875 dv-cinder-844563-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 10:24:06.911993 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 10:24:06 2022] *** Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: nodename: dv-cinder-844563-7-iscsi Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: machine: x86_64 Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: clock source: unix Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: pcre jit disabled Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: detected number of CPU cores: 4 Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: current working directory: / Sep 26 10:24:06.913985 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: detected binary path: /usr/bin/uwsgi-core Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: your processes number limit is 47680 Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: your memory page size is 4096 bytes Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: detected max file descriptor number: 2048 Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: lock engine: pthread robust mutexes Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: thunder lock: enabled Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 10:24:06.914695 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 10:24:06.952865 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: Python main interpreter initialized at 0x55b5c05149c0 Sep 26 10:24:06.952865 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: python threads support enabled Sep 26 10:24:06.952865 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: your server socket listen backlog is limited to 100 connections Sep 26 10:24:06.952865 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: your mercy for graceful operations on workers is 90 seconds Sep 26 10:24:06.953172 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 10:24:06.953269 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: *** Operational MODE: preforking *** Sep 26 10:24:06.953523 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: *** uWSGI is running in multiple interpreter mode *** Sep 26 10:24:06.953523 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: spawned uWSGI master process (pid: 105397) Sep 26 10:24:06.953695 dv-cinder-844563-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 10:24:06.954253 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: spawned uWSGI worker 1 (pid: 105398, cores: 1) Sep 26 10:24:06.954593 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: spawned uWSGI worker 2 (pid: 105399, cores: 1) Sep 26 10:24:06.954754 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 10:24:07.621208 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 10:24:07.631007 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 10:24:08.700144 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:24:08.700144 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: from cryptography.utils import int_from_bytes Sep 26 10:24:08.700774 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:24:08.700774 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: from cryptography.utils import int_from_bytes Sep 26 10:24:08.702732 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:24:08.702732 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: from cryptography.utils import int_from_bytes Sep 26 10:24:08.703152 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:24:08.703152 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: from cryptography.utils import int_from_bytes Sep 26 10:24:11.160068 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 10:24:11.160609 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 10:24:11.160710 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 10:24:11.160710 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 10:24:11.161128 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 10:24:11.161128 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 10:24:11.161299 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 10:24:11.161385 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 10:24:11.161460 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 10:24:11.161724 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 10:24:11.161831 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162006 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162147 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162344 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162448 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162658 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162758 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.162984 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.163078 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.163288 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.163382 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.163602 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.163699 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.163916 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164022 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164228 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164323 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164484 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164576 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164793 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.164885 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.165103 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.165194 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-7-iscsi {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.165417 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.165510 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-7-iscsi {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.165719 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.165811 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166052 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166202 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166357 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166455 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166655 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166738 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.166960 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.167078 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.167276 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.167963 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.168139 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.168329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.168642 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.168822 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.168937 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169052 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169244 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169364 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169552 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169733 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169903 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.169999 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.170233 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.170326 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.170548 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.170669 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.170872 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.170961 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.171180 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.171279 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.171486 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.171577 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.171799 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.171896 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-7-iscsi {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.172176 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.172267 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-7-iscsi {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.172485 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.172587 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.172793 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.172877 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.173105 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.173191 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.173489 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.173583 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.173796 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.173882 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.174123 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.174231 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.174442 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.174533 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.174746 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.174838 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.175069 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.175156 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.175384 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.175470 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.175699 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.175797 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176011 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176102 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176309 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176400 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176611 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176704 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.176915 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177007 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177217 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177310 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177516 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177607 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177817 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.177909 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.178091 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.178190 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.178384 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.178480 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.178691 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.178784 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179002 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179094 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179318 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179412 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179565 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179661 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179814 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.179910 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.180110 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.180201 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.180427 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.180518 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.180734 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.180825 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181038 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181130 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181338 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181430 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181640 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181735 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.181939 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182121 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182264 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182366 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182564 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182661 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182865 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.182954 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.183192 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.183285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.183499 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.183593 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.183809 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.183894 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.184108 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.184205 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.184421 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.184520 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.184737 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.184836 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185043 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185137 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185346 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185442 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185664 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185750 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.185976 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.186110 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.186305 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.186443 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.186620 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.186707 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.186934 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187020 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187234 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187356 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187536 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187623 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187836 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.187928 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.188142 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.188228 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.188460 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.188546 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.188757 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.188851 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189006 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189093 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189299 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189393 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189596 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189699 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189898 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.189984 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.190232 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.190328 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.190537 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.190632 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.190838 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.190933 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.191131 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.191227 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.191427 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.191593 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.191727 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.191818 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192027 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192112 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192328 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192421 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192631 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.192948 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.193170 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.193264 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.193472 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.193564 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.193775 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.193870 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.194125 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.194238 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.194402 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.194489 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.194716 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.194802 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195031 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195125 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195335 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195426 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195633 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195735 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.195934 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196029 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196236 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196321 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196548 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196643 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196849 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.196944 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.197147 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.197238 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.197464 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.197555 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.197763 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.197856 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.198084 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.198181 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.198400 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.198488 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.198729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.198832 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199029 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199114 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199343 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199433 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199636 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199730 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.199939 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200023 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200250 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200342 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200557 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200644 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200858 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.200988 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.201156 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.201242 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.201453 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.201539 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.201751 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.201842 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202067 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202169 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202368 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202455 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202667 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202760 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.202961 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203054 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203274 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203366 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203586 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203671 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203889 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.203984 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.204213 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.204314 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.204485 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.204576 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.204797 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.204896 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:24:11.205127 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.205220 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.205450 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.205541 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.205788 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.205884 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.206120 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.206220 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.206449 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.206539 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.206778 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.206875 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.207092 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.207186 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.207400 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.207487 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.207709 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.207798 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208031 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208117 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208339 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208424 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208645 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208737 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.208950 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209035 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209265 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209370 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209577 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209663 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209904 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.209997 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.210242 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.210339 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.210557 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.210643 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.210871 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.210959 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.211175 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.211263 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.211490 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.211584 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.212072 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.212164 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.212387 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.212480 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.212695 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.212783 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.213034 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.213120 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.213374 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.213469 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.213685 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.213771 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.214005 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.214113 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.214861 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.214979 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.215166 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.215252 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.215472 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.215557 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.215774 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.215871 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.216112 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.216198 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.216417 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.216511 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.216726 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.216820 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217036 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217122 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217344 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217431 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217662 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.217966 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218106 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218299 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218385 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218605 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218692 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218912 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.218998 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.219214 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.219307 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.219544 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.219640 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.219854 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.219939 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.220170 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.220256 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.220481 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.220574 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.220789 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.220874 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.221104 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.221202 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.221412 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.221500 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.221719 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.221805 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222039 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222144 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222348 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222435 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222649 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222734 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.222948 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223046 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223252 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223338 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223551 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223639 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223866 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.223964 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.224189 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.224273 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.224491 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.224583 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.224822 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.224968 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.225122 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.225221 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.225424 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.225530 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.225729 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.225835 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226041 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226139 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226353 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226656 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226759 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.226964 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227062 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227261 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227348 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227580 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227669 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227887 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.227991 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.228187 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.228272 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.228503 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.228597 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.228805 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.228898 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.229106 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.229201 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.229418 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.229503 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.229723 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.229809 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.230611 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.230741 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.230927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231076 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231237 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231370 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231555 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231695 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231865 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.231998 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.232170 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.232300 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.232501 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.232639 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.232828 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.232968 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.233128 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.233257 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.233447 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.233579 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.233766 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.233903 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.234099 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.234189 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.234399 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.234487 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.234704 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.234791 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235002 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235091 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235300 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235386 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235597 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235681 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235898 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.235996 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.236196 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.236282 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.236494 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.236579 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.236792 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.236886 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.237089 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.237174 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.237385 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.237470 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.237702 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.237797 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238007 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238134 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238416 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238628 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238726 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.238925 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239011 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239261 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239352 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239562 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239656 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239899 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.239984 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.240226 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.240315 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.240539 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.240635 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.240857 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.240942 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.241169 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.241259 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.241480 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.241570 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.241786 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.241871 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.242112 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.242200 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.242421 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.242511 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.242727 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.242812 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243038 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243130 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243343 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243438 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243657 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243742 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.243960 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.244060 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.244279 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.244364 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.244583 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.244670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.244896 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245033 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245195 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245281 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245525 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245613 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245860 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.245958 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.246212 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.246298 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.246525 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.246609 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.246840 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.246941 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.247146 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.247238 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.247452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.247537 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.247758 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.247846 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248062 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248147 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248364 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248456 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248668 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248754 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.248977 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249063 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249283 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249368 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249592 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249677 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249894 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.249982 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.250236 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.250330 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.250542 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.250628 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.250855 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.250941 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.251159 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.251244 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.251470 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.251556 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.251790 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.251876 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.252117 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.252216 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.252421 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.252506 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.252725 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.252810 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253042 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253137 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253343 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253428 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253645 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253735 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.253951 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254072 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254274 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254359 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254574 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254659 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254875 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.254973 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.255185 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.255273 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.255499 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.255608 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.255795 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.255886 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256091 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256183 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256398 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256484 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256700 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256792 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.256996 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257082 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257293 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257378 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257596 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257690 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257911 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.257996 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.258240 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.258340 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.258552 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.258639 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.258868 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.258954 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.259164 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.259257 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.259463 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.259549 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.259778 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.259872 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260078 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260180 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260374 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260460 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260669 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260842 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.260966 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.261062 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.261824 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.261917 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.262151 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.262243 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.262454 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.262558 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.262761 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.262854 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263075 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263160 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263379 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263472 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263769 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.263985 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264071 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264286 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264373 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264603 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264689 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264909 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.264995 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.265211 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.265306 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.265514 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.265608 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.265819 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.265910 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.266144 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.266233 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.266450 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.266546 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.266766 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.266861 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267069 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267162 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267371 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267462 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267675 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267770 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.267990 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.268086 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.268276 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.268363 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.268586 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.268684 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.269143 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.269240 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.269469 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.269561 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.269780 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.269874 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.270116 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.270204 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.270456 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.270619 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.270770 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.270871 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.271097 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.271191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.271419 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.271546 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.271732 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.271854 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272029 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272168 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272334 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272422 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272633 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272719 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.272932 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273028 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273237 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273322 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273536 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273622 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273835 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.274154 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.274241 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.274460 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.274545 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.274756 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.274843 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275055 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275143 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275353 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275441 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275649 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275747 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.275955 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.276042 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.276253 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.276338 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.276556 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.276649 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.277388 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.277523 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.277708 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.277804 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278012 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278110 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278333 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278418 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278630 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.278927 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279012 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279263 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279350 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279564 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279658 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279893 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.279987 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.280219 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.280304 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.280550 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.280644 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.280850 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.280943 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.281147 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.281232 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.281464 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.281558 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.281765 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.281850 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282079 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282201 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282378 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282467 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282680 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282765 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.282976 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283061 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283273 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283359 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283574 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283658 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283878 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.283962 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.284178 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.284272 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.284481 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.284567 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.284774 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.284876 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285076 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285168 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285370 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285456 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285679 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285773 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.285980 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286095 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286302 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286391 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286599 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286694 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286899 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.286985 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.287200 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.287286 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.287496 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.287595 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.287799 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.287885 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288094 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288187 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288403 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288536 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288698 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288784 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.288995 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289080 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289289 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289375 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289592 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289679 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289893 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.289978 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.290212 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.290300 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.290531 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.290618 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.290837 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.290924 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.291133 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.291219 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.291427 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.291512 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.291736 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.291830 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292033 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292162 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292346 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292485 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292657 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292771 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.292974 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293071 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293280 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293368 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293577 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293672 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293879 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.293966 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.294201 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.294291 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.294498 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.294599 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.294794 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.294881 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295093 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295181 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295388 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295478 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295683 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295770 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.295980 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296069 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296276 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296363 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296570 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296657 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296885 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.296972 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.297188 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.297276 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.297484 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.297570 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.297779 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.297865 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.298096 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.298199 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.298436 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.298536 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.298737 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.298845 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.299088 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.299184 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.299388 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.299475 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.299698 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.299792 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300010 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300095 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300314 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300401 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300619 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300719 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.300928 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301013 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301223 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301316 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301535 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301630 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301839 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.301944 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.302229 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.302350 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.302446 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.302536 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.302750 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.302857 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303064 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303151 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303369 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303459 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303674 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303762 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.303987 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.304075 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.304302 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.304398 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.304616 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.304704 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.304913 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305000 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305216 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305304 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305520 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305607 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305821 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.305908 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.306147 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.306239 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.306453 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.306552 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.306757 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.306857 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307062 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307151 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307368 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307462 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307671 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307771 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.307994 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.308081 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.308297 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.308383 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.308599 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.308694 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.308903 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309000 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309199 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309294 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309516 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309617 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309818 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.309904 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.310138 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.310226 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.310443 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.310530 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.310741 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.310826 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.311042 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.311127 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.311343 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.311430 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.311766 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.311861 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312071 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312179 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312376 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312471 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312675 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312775 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.312979 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313076 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313280 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313375 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313589 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313673 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313895 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.313989 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.314221 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.314318 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.314629 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.314715 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.314935 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315030 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315237 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315323 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315542 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315628 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315840 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.315935 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.316135 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.316221 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.316439 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.316527 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.316757 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.316851 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317055 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317141 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317353 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317449 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317650 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317739 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.317967 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.318087 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.318291 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.318377 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.318606 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.318694 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.319017 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.319113 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.319321 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.319406 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.319619 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.319714 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320027 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320115 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320332 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320431 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320634 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320813 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.320951 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321039 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321266 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321360 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321587 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321675 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321887 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.321976 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.322219 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.322309 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.322523 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.322628 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.322842 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.322931 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.323161 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.323251 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.323464 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.323563 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.324295 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.324391 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.324597 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.324691 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.324915 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325016 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325233 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325319 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325540 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325625 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325856 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.325952 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.326290 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.326378 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.326606 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.326692 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.326914 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327001 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327228 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327314 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327550 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327644 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327849 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.327938 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.328152 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.328248 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.328455 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.328548 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.328755 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.328842 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329052 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329138 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329371 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329465 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329667 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329762 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.329974 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330118 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330305 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330408 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330607 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330694 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330906 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.330999 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.331202 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.331302 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.331521 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.331613 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.331819 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.331905 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.332142 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.332243 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.332451 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.332546 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.332768 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.332866 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.333085 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.333225 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.333381 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.333467 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.333699 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.333786 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334002 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334150 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334324 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334430 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334624 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334711 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.334919 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335008 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335257 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335344 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335556 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335643 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335873 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.335971 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.336200 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.336288 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.336524 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.336611 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.337086 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.337187 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.337413 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.337508 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.337738 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.337834 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.338074 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.338164 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.338385 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.338472 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.338699 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.338799 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.339022 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.339146 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340051 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340152 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340242 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340338 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340457 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340553 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340762 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.340849 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341068 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341158 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341367 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341454 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341671 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341768 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.341969 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.342074 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.342294 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.342392 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.342591 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.342678 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.342909 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343001 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343208 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343298 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343524 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343620 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343828 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.343917 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.344127 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.344215 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.344425 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.344512 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.344721 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.344808 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345055 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345143 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345356 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345452 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345679 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345772 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.345981 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.346104 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.346322 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.346429 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.346636 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.346723 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.346944 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347031 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347254 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347349 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347561 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347655 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347869 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.347957 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.348179 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.348279 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.348486 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.348574 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.348791 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.348879 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.349102 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.349189 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.349411 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.349508 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.349722 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.349815 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.350255 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.350359 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.350581 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.350679 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.350891 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.350979 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.351200 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.351289 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.351509 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.351597 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.351815 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.351914 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.352131 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.352226 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.352437 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.352532 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.352743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.352853 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353049 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353145 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353442 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353677 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353776 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.353992 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.354125 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.354334 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.354435 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.354668 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.354756 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355001 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355095 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355313 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355400 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355631 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355728 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.355925 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356013 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356274 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356374 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356584 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356671 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356885 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.356973 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.357194 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.357295 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.357502 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.357591 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.357813 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.357901 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.358144 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.358248 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.358453 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.358540 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.358759 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.358847 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359068 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359155 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359370 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359456 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359674 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359767 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.359979 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.360080 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.360287 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.360374 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.360604 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.360690 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.360933 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.361033 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.361258 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.361345 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.361555 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.361658 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.361861 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.362013 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.362202 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.362288 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.362710 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.362856 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363024 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363143 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363350 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363467 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363673 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363782 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.363992 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.364081 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.364305 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.364412 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.364616 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.364708 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.364937 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365025 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365236 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365323 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365534 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365641 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365838 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.365926 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.366165 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.366258 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.366467 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.366556 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.366785 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.366871 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367086 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367173 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367387 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367475 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367701 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367787 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.367999 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.368086 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.368521 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.368617 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.368861 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.368946 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.369171 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.369271 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.369493 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.369580 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.369810 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.369905 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.370144 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.370248 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.370449 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.370538 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.370793 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.370880 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.371095 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.371192 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.371396 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.371484 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.371706 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.371800 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372012 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372100 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372316 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372403 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372611 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372698 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.372917 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373004 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373218 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373308 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373521 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373643 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373826 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.373938 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.374151 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.374316 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.374497 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.374638 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.374789 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.374934 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375079 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375216 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375359 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375504 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375659 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375797 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.375946 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376081 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376220 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376318 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376515 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376602 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376815 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.376901 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.377117 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.377217 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.377417 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.377503 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.377718 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.377805 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378029 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378136 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378344 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378432 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378691 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378777 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.378994 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.379082 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.379294 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.379380 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.379613 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.379707 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.379914 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380002 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380210 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380518 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380606 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380822 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.380911 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.381140 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.381235 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.381447 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.381542 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.381754 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.381848 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.382120 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.382212 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.382433 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.382520 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.382957 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.383047 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.383287 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.383382 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.383616 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.383761 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.383933 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384027 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384258 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384344 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384561 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384657 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384864 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.384961 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.385163 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.385251 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.385482 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.385582 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.385790 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.385879 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.386662 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.386758 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.386981 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387070 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387290 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387376 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387593 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387680 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387899 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.387992 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.388205 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.388292 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.388508 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.388595 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.388810 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.388898 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.389113 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.389200 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.389415 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.389511 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.389718 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.389805 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390035 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390124 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390345 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390443 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390656 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390742 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.390990 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.391076 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.391306 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.391402 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.391618 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.391705 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.391931 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392020 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392243 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392338 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392548 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392634 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392853 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.392938 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.393156 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.393248 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.393461 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.393551 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.393771 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.393859 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.394120 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.394212 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.394428 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.394526 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.394729 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.394834 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.395377 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.395465 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.395692 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.395779 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396015 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396111 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396335 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396426 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396645 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396740 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.396965 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.397061 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.397285 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.397372 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.397593 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.397680 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.397914 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398001 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398246 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398333 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398577 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398663 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398909 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.398998 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.399234 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.399320 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.399554 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.399647 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.399856 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.399944 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.400156 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.400242 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.400457 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.400543 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.400764 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.400852 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.401078 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.401164 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.401382 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.401478 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.401683 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.401799 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.402562 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.402668 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.402878 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.402976 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.403184 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.403279 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.403490 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.403578 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.403795 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.403931 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404095 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404190 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404398 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404485 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404697 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404836 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.404999 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405087 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405297 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405399 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405597 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405689 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405893 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.405987 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.406216 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.406305 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.406520 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.406608 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.406819 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.406905 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.407118 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.407205 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.407417 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.407505 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.407715 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.407800 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408012 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408099 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408339 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408427 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408668 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408760 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.408975 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.409071 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.409296 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.409384 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.409605 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.409691 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.409919 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410013 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410291 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410396 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410568 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410655 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410882 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.410978 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.411192 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.411286 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.411498 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.411584 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.411823 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.411919 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.412129 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.412222 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.412432 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.412519 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.412745 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.412832 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413048 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413134 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413353 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413439 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413656 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413751 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.413978 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.414093 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.414324 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.414411 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.414624 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.414712 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.414944 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415032 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415257 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415352 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415568 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415655 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415879 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.415967 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.416186 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.416281 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.416506 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.416593 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.416811 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.416899 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.417116 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.417214 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.417440 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.417531 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.417747 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.417835 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418071 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418163 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418387 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418476 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418691 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418780 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.418998 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.419086 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.419307 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.419401 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.419616 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.419703 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.419934 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420022 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420254 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420340 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420559 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420653 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420880 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.420966 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.421198 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.421284 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.421539 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.421640 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.421846 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.421933 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.422209 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.422300 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.422535 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.422635 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.422847 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.422934 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.423150 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.423236 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.423451 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.423617 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:24:11.423751 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 10:24:11.423844 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 10:24:11.575599 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Registered counter for database nova_api Sep 26 10:24:11.576190 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Registered counter for database nova_api Sep 26 10:24:11.596783 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.598463 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.603368 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.604953 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.660068 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.context [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e066cc03-4cbd-4f04-8c08-1a760e88bbb8(cell1) {{(pid=105398) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 10:24:11.661979 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.context [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e066cc03-4cbd-4f04-8c08-1a760e88bbb8(cell1) {{(pid=105399) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 10:24:11.663952 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:24:11.664612 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:24:11.665783 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:24:11.665952 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:24:11.666278 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:24:11.666692 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:24:11.667138 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:24:11.668239 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:24:11.668722 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:24:11.669017 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:24:11.669169 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_concurrency.lockutils [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:24:11.671038 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:24:11.671144 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Registered counter for database nova_cell0 Sep 26 10:24:11.673010 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Registered counter for database nova_cell0 Sep 26 10:24:11.675125 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Registered counter for database nova_cell1 Sep 26 10:24:11.676998 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Registered counter for database nova_cell1 Sep 26 10:24:11.682627 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.685320 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.687108 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.688879 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.690948 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.692707 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.695070 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.696525 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.840068 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO dbcounter [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Registered counter for database nova_cell0 Sep 26 10:24:11.843835 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO dbcounter [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Registered counter for database nova_cell0 Sep 26 10:24:11.846904 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG oslo_db.sqlalchemy.engines [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.851521 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writer thread running {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:11.852389 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_db.sqlalchemy.engines [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:24:11.856982 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writer thread running {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:24:12.188388 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:24:12.189539 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:24:12.195644 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:24:12.196805 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:24:12.540326 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:24:12.544278 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:24:12.546849 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: WARNING keystonemiddleware.auth_token [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:24:12.550253 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: WARNING keystonemiddleware.auth_token [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:24:12.552110 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b5c05149c0 pid: 105398 (default app) Sep 26 10:24:12.554224 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:24:12.555410 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-45faf02f-af24-4dcc-b574-2932dba09237 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001789 Sep 26 10:24:12.555497 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b5c05149c0 pid: 105399 (default app) Sep 26 10:24:12.555806 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Mon Sep 26 10:24:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:34.046466 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:34.047687 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Sep 26 10:25:34.048098 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:34.064978 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=3 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:34.066434 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_cell1:SELECT=3 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:34.067563 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_cell0:SELECT=3 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:34.068445 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:34.946782 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-793a7307-b1cb-4c53-afce-5d7993113caf admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:34.979853 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-793a7307-b1cb-4c53-afce-5d7993113caf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925589 Sep 26 10:25:34.980629 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 10:25:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:25:37.579885 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:37.580902 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-aa4b14a6-8dd1-4c8b-9f62-ac6cd2498f74 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 26 10:25:37.581591 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 2/4] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:38.041085 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-735aa5ae-9bee-47f3-974c-4d122a2d7e0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:38.087304 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-735aa5ae-9bee-47f3-974c-4d122a2d7e0f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.499817 Sep 26 10:25:38.087870 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 3/5] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:25:38.102122 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=3 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:38.102975 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell1:SELECT=3 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:38.104032 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell0:SELECT=3 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:38.104949 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:25:38.313478 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-3e64ef4e-d8aa-4fb2-b299-64ae513ff734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:38.383810 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-3e64ef4e-d8aa-4fb2-b299-64ae513ff734 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286561 Sep 26 10:25:38.384079 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 3/6] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 10:25:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:25:40.993746 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-735aa5ae-9bee-47f3-974c-4d122a2d7e0f admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:40.994830 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-735aa5ae-9bee-47f3-974c-4d122a2d7e0f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 26 10:25:40.995221 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 4/7] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:41.639129 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b6ed3799-f792-44f8-a57f-4e0ec7a3cff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:41.682998 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b6ed3799-f792-44f8-a57f-4e0ec7a3cff8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.680895 Sep 26 10:25:41.683949 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 4/8] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:25:41.697388 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-3d1f7aa9-51ad-43c7-9b48-019448f5c73a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:41.741454 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-3d1f7aa9-51ad-43c7-9b48-019448f5c73a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048589 Sep 26 10:25:41.742123 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 5/9] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 10:25:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:25:44.529219 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b6ed3799-f792-44f8-a57f-4e0ec7a3cff8 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:44.530453 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b6ed3799-f792-44f8-a57f-4e0ec7a3cff8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Sep 26 10:25:44.530972 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:44.945643 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-0ba080fc-93cb-4d58-b506-6eaf980aae26 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:44.969143 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-0ba080fc-93cb-4d58-b506-6eaf980aae26 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.431603 Sep 26 10:25:44.969720 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 6/11] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:25:44.982759 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-dd6f473a-2f00-45a0-b321-1366491c98dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:45.013394 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-dd6f473a-2f00-45a0-b321-1366491c98dd admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034854 Sep 26 10:25:45.014320 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 6/12] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 10:25:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:25:47.631215 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-0ba080fc-93cb-4d58-b506-6eaf980aae26 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:47.632221 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-0ba080fc-93cb-4d58-b506-6eaf980aae26 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 26 10:25:47.632624 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 7/13] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:48.059757 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-3f5a7add-6a90-4471-b94e-844b0cd8b17a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:48.079842 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-3f5a7add-6a90-4471-b94e-844b0cd8b17a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441198 Sep 26 10:25:48.080484 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 7/14] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:25:48.093469 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1a3d6ee6-0f7c-44e5-adfa-21f12ba75d71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:48.121745 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-1a3d6ee6-0f7c-44e5-adfa-21f12ba75d71 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031921 Sep 26 10:25:48.122459 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 8/15] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 10:25:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:25:50.779488 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-3f5a7add-6a90-4471-b94e-844b0cd8b17a admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:50.780513 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-3f5a7add-6a90-4471-b94e-844b0cd8b17a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 26 10:25:50.780920 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 8/16] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:51.185826 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-4e8fcde5-3bc3-4908-bcb2-244f1353aa4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:51.204262 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-4e8fcde5-3bc3-4908-bcb2-244f1353aa4e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.416965 Sep 26 10:25:51.204820 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 9/17] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:25:51.217175 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-013bd308-e6e7-4df6-b36d-b4fbbe4e77fb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:51.243299 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-013bd308-e6e7-4df6-b36d-b4fbbe4e77fb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029958 Sep 26 10:25:51.245094 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 9/18] 10.222.0.49 () {64 vars in 1336 bytes} [Mon Sep 26 10:25:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:25:53.822330 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-4e8fcde5-3bc3-4908-bcb2-244f1353aa4e admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:53.823978 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-4e8fcde5-3bc3-4908-bcb2-244f1353aa4e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Sep 26 10:25:53.824630 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 10/19] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:54.234224 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-99b36d10-6175-4591-879f-435e04c324b3 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:54.259603 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-99b36d10-6175-4591-879f-435e04c324b3 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.428994 Sep 26 10:25:54.260144 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 10/20] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 10:25:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:25:56.869163 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-4e8fcde5-3bc3-4908-bcb2-244f1353aa4e admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:56.870766 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-4e8fcde5-3bc3-4908-bcb2-244f1353aa4e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002057 Sep 26 10:25:56.871214 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 11/21] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:25:57.262677 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-4d33c18b-2e4f-481b-9566-e116d6b5dd8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:57.281353 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-4d33c18b-2e4f-481b-9566-e116d6b5dd8a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.403312 Sep 26 10:25:57.281896 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 11/22] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:25:57.294489 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-4bd2e877-0476-4020-8388-00932e900769 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:25:57.321374 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-4bd2e877-0476-4020-8388-00932e900769 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031160 Sep 26 10:25:57.321940 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 12/23] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 10:25:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:25:59.912199 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-4d33c18b-2e4f-481b-9566-e116d6b5dd8a admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:25:59.913205 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-4d33c18b-2e4f-481b-9566-e116d6b5dd8a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 26 10:25:59.913610 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:00.307041 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1913e05b-2902-4739-ac4a-28a7c152886c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "id": "2"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:00.328185 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-1913e05b-2902-4739-ac4a-28a7c152886c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.407750 Sep 26 10:26:00.328764 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 13/25] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:25:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:26:00.341732 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-4e12a5f2-4edd-4521-b92e-ea295e2302b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:00.365095 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-4e12a5f2-4edd-4521-b92e-ea295e2302b5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027849 Sep 26 10:26:00.365766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 13/26] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 10:26:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:26:02.991548 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-1913e05b-2902-4739-ac4a-28a7c152886c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:02.992529 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-1913e05b-2902-4739-ac4a-28a7c152886c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 26 10:26:02.993076 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 14/27] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:26:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:03.437694 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b4f4dae0-d4d0-4628-a93a-62c469ddb5a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:03.473023 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b4f4dae0-d4d0-4628-a93a-62c469ddb5a2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470540 Sep 26 10:26:03.474098 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 14/28] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:26:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:26:03.490211 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-4d8ab3d7-2109-4ce3-8fac-0a703be1948a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:03.564126 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-4d8ab3d7-2109-4ce3-8fac-0a703be1948a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077683 Sep 26 10:26:03.565110 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 15/29] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 10:26:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:26:06.182665 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-b4f4dae0-d4d0-4628-a93a-62c469ddb5a2 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:06.183688 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-b4f4dae0-d4d0-4628-a93a-62c469ddb5a2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Sep 26 10:26:06.184089 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:06.646504 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-94c3b17c-9207-4c8b-9e16-fa6d6ac8bbb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:06.655494 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:06.668929 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-94c3b17c-9207-4c8b-9e16-fa6d6ac8bbb7 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.478920 Sep 26 10:26:06.669688 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 16/31] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:26:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:26:06.682142 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-70ca148d-28ce-4d47-b8ec-8acebc477bc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:06.707423 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-70ca148d-28ce-4d47-b8ec-8acebc477bc0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029060 Sep 26 10:26:06.708459 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 16/32] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 10:26:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:26:09.416841 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-94c3b17c-9207-4c8b-9e16-fa6d6ac8bbb7 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:09.418631 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-94c3b17c-9207-4c8b-9e16-fa6d6ac8bbb7 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Sep 26 10:26:09.419171 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:26:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:09.868761 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-cf8f103a-a981-4222-83f3-9d96359c930b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:09.877215 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:09.897334 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-cf8f103a-a981-4222-83f3-9d96359c930b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.471571 Sep 26 10:26:09.902817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 17/34] 10.222.0.49 () {64 vars in 1283 bytes} [Mon Sep 26 10:26:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:26:09.909446 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-30b0b396-8b3f-42e3-8a03-b604f65f2888 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:09.944954 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-30b0b396-8b3f-42e3-8a03-b604f65f2888 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039106 Sep 26 10:26:09.945652 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 18/35] 10.222.0.49 () {64 vars in 1333 bytes} [Mon Sep 26 10:26:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:26:26.448360 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-cf8f103a-a981-4222-83f3-9d96359c930b admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:26.449287 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-cf8f103a-a981-4222-83f3-9d96359c930b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Sep 26 10:26:26.449690 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 18/36] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:26:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:26.461103 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:26:26.853099 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-43a43825-a585-499f-8c82-0aa3a0384901 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:26.871618 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-43a43825-a585-499f-8c82-0aa3a0384901 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415068 Sep 26 10:26:26.872150 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 19/37] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 10:26:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:26:28.167415 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-cf8f103a-a981-4222-83f3-9d96359c930b admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:28.168417 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-cf8f103a-a981-4222-83f3-9d96359c930b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 26 10:26:28.168813 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 19/38] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:26:28.693237 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-6e510650-effe-4ce7-955c-768fe13d524f admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:28.698501 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.wsgi [None req-6e510650-effe-4ce7-955c-768fe13d524f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-6e510650-effe-4ce7-955c-768fe13d524f admin admin] Request method failure captured: Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Accept: application/json Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Accept-Encoding: gzip, deflate Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Connection: keep-alive Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Content-Length: 0 Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Host: 10.222.0.49 Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Openstack-Api-Version: compute 2.92 Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Openstack-System-Scope: None Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: User-Agent: python-novaclient Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Auth-Token: gAAAAABjMX5Uaa-LA-L0K4mk4R0LRGIlZ0Mew4V7OMpvroh2fgrY69T-Ho71S_b-rk2jTCmRVmmcm0q0GN5qTtWsswgb6d7P0_iHte0w8Khsa9nFc__zwMIrA6h9w4mOiShyJ-wWnp40myKh96pYCdii7GYCp7a5b9btcYhr16DiFNFRnjBJoaE Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Domain-Id: None Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Domain-Name: None Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Identity-Status: Confirmed Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Is-Admin-Project: True Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Domain-Id: default Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Domain-Name: Default Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Name: admin Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Role: reader,admin,member Sep 26 10:26:28.701753 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Roles: reader,admin,member Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cef67c15d1f4b9695af7c22c68b5822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant: admin Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant-Name: admin Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User: admin Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Domain-Id: default Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Domain-Name: Default Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Id: 7ecff1fbd79248b7bcd1e69035be3515 Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Name: admin Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: method: > Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: exception: Flavor 42 could not be found. Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: action_args: {'id': '42'} Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:26:28.703423 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:28.704329 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.705743 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-6e510650-effe-4ce7-955c-768fe13d524f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:26:28.708029 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-6e510650-effe-4ce7-955c-768fe13d524f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398880 Sep 26 10:26:28.708029 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 10:26:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:28.713431 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-8de36f93-7542-4429-8e5b-7f3b84e4751b admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:28.736949 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-8de36f93-7542-4429-8e5b-7f3b84e4751b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027429 Sep 26 10:26:28.737495 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 20/40] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 10:26:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:26:28.748566 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-28f2beb7-f247-4a16-8672-becb18eecdd9 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:28.769969 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-28f2beb7-f247-4a16-8672-becb18eecdd9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026460 Sep 26 10:26:28.770529 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 21/41] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 10:26:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:26:28.779654 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-70371864-c6f5-437c-9de6-cceccf43e1c7 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:28.785241 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.wsgi [None req-70371864-c6f5-437c-9de6-cceccf43e1c7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-70371864-c6f5-437c-9de6-cceccf43e1c7 admin admin] Request method failure captured: Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Accept: application/json Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Accept-Encoding: gzip, deflate Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Connection: keep-alive Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Content-Length: 0 Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Host: 10.222.0.49 Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Openstack-Api-Version: compute 2.92 Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Openstack-System-Scope: None Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: User-Agent: python-novaclient Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Auth-Token: gAAAAABjMX5Uaa-LA-L0K4mk4R0LRGIlZ0Mew4V7OMpvroh2fgrY69T-Ho71S_b-rk2jTCmRVmmcm0q0GN5qTtWsswgb6d7P0_iHte0w8Khsa9nFc__zwMIrA6h9w4mOiShyJ-wWnp40myKh96pYCdii7GYCp7a5b9btcYhr16DiFNFRnjBJoaE Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Domain-Id: None Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Domain-Name: None Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Identity-Status: Confirmed Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Is-Admin-Project: True Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Domain-Id: default Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Domain-Name: Default Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Name: admin Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Role: reader,admin,member Sep 26 10:26:28.788621 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Roles: reader,admin,member Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cef67c15d1f4b9695af7c22c68b5822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant: admin Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant-Name: admin Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User: admin Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Domain-Id: default Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Domain-Name: Default Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Id: 7ecff1fbd79248b7bcd1e69035be3515 Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Name: admin Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: method: > Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: exception: Flavor 42 could not be found. Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: action_args: {'id': '42'} Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:26:28.790178 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:28.791728 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:28.792930 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-70371864-c6f5-437c-9de6-cceccf43e1c7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:26:28.793963 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-70371864-c6f5-437c-9de6-cceccf43e1c7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013860 Sep 26 10:26:28.793963 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 21/42] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 10:26:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:30.012712 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-28f2beb7-f247-4a16-8672-becb18eecdd9 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:30.013729 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-28f2beb7-f247-4a16-8672-becb18eecdd9 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 26 10:26:30.014177 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:30.561076 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a94095ab-cacf-4ad7-8c68-94f889c572cf admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:30.566262 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.wsgi [None req-a94095ab-cacf-4ad7-8c68-94f889c572cf admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a94095ab-cacf-4ad7-8c68-94f889c572cf admin admin] Request method failure captured: Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Accept: application/json Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Accept-Encoding: gzip, deflate Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Connection: keep-alive Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Content-Length: 0 Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Host: 10.222.0.49 Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Openstack-Api-Version: compute 2.92 Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Openstack-System-Scope: None Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: User-Agent: python-novaclient Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Auth-Token: gAAAAABjMX5VdCMCBZ4-mSc5C_vS8RYKVD2kDDk9GhqQ4P2nYeiG5Ij7LjOUkk1LKetBogaZgGY0ENodb2ZmGjeBni9fQE5xcAhxx9tjkVNAf_L2D6ElXlV6m5SH7NfZ2Y6OjzZ0IXAtr9zwzrgZs-iNOWEITmke0OiSUc2htOevgssq04HZ64k Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Domain-Id: None Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Domain-Name: None Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Identity-Status: Confirmed Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Is-Admin-Project: True Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Domain-Id: default Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Domain-Name: Default Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Name: admin Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Role: reader,admin,member Sep 26 10:26:30.567766 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Roles: reader,admin,member Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cef67c15d1f4b9695af7c22c68b5822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant: admin Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant-Name: admin Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User: admin Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Domain-Id: default Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Domain-Name: Default Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Id: 7ecff1fbd79248b7bcd1e69035be3515 Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Name: admin Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: method: > Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: exception: Flavor 84 could not be found. Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: action_args: {'id': '84'} Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:26:30.569303 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:30.570329 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.571817 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a94095ab-cacf-4ad7-8c68-94f889c572cf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:26:30.573872 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a94095ab-cacf-4ad7-8c68-94f889c572cf admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.406878 Sep 26 10:26:30.573872 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 22/44] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 10:26:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:30.579508 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-23b70015-c41f-47ad-865c-28a6434e6ef7 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:30.594504 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-23b70015-c41f-47ad-865c-28a6434e6ef7 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018523 Sep 26 10:26:30.595043 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 23/45] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 10:26:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:26:30.604311 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-0c985a17-1986-4b87-88f9-0ee18c1bd64c admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:30.619965 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-0c985a17-1986-4b87-88f9-0ee18c1bd64c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018736 Sep 26 10:26:30.620491 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 10:26:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:26:30.629435 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-aa839f9a-def2-46d4-bc68-7406bb827dd8 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:30.634543 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.wsgi [None req-aa839f9a-def2-46d4-bc68-7406bb827dd8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-aa839f9a-def2-46d4-bc68-7406bb827dd8 admin admin] Request method failure captured: Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Accept: application/json Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Accept-Encoding: gzip, deflate Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Connection: keep-alive Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Content-Length: 0 Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Host: 10.222.0.49 Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Openstack-Api-Version: compute 2.92 Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Openstack-System-Scope: None Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: User-Agent: python-novaclient Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Auth-Token: gAAAAABjMX5VdCMCBZ4-mSc5C_vS8RYKVD2kDDk9GhqQ4P2nYeiG5Ij7LjOUkk1LKetBogaZgGY0ENodb2ZmGjeBni9fQE5xcAhxx9tjkVNAf_L2D6ElXlV6m5SH7NfZ2Y6OjzZ0IXAtr9zwzrgZs-iNOWEITmke0OiSUc2htOevgssq04HZ64k Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Domain-Id: None Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Domain-Name: None Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Identity-Status: Confirmed Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Is-Admin-Project: True Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Domain-Id: default Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Domain-Name: Default Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Name: admin Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Role: reader,admin,member Sep 26 10:26:30.636686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Roles: reader,admin,member Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cef67c15d1f4b9695af7c22c68b5822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant: admin Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant-Name: admin Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User: admin Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Domain-Id: default Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Domain-Name: Default Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Id: 7ecff1fbd79248b7bcd1e69035be3515 Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Name: admin Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: method: > Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: exception: Flavor 84 could not be found. Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: action_args: {'id': '84'} Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:26:30.638285 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:30.639452 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:30.640927 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-aa839f9a-def2-46d4-bc68-7406bb827dd8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:26:30.642176 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-aa839f9a-def2-46d4-bc68-7406bb827dd8 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012050 Sep 26 10:26:30.642176 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 24/47] 10.222.0.49 () {60 vars in 1190 bytes} [Mon Sep 26 10:26:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 26 10:26:31.857406 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-0c985a17-1986-4b87-88f9-0ee18c1bd64c admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:31.858485 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-0c985a17-1986-4b87-88f9-0ee18c1bd64c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 26 10:26:31.858886 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 24/48] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:32.376001 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-19c78a6c-ee5b-4d17-8cde-af7d82fcb3c0 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:32.381806 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.wsgi [None req-19c78a6c-ee5b-4d17-8cde-af7d82fcb3c0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-19c78a6c-ee5b-4d17-8cde-af7d82fcb3c0 admin admin] Request method failure captured: Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Accept: application/json Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Accept-Encoding: gzip, deflate Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Connection: keep-alive Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Content-Length: 0 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Host: 10.222.0.49 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Openstack-Api-Version: compute 2.92 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Openstack-System-Scope: None Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: User-Agent: python-novaclient Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Auth-Token: gAAAAABjMX5XGLCFw8c18XRmjPbKMRe59DJQyFeGVwlrChd2VK_r54BoNqLwyHcIdEmE3urV6z7K5U3ChJy8VZTFbEhhGHAdX37zf7WDgy9G-2R5PbLOiaE_w8P-DBl3hv0xcfpSz0yXU6zV04WMr9IVeBTflDaovwUxjSfeKl9MNieKuzH7xb8 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Domain-Id: None Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Domain-Name: None Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Identity-Status: Confirmed Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Is-Admin-Project: True Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Domain-Id: default Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Domain-Name: Default Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Project-Name: admin Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Role: reader,admin,member Sep 26 10:26:32.383354 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Roles: reader,admin,member Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cef67c15d1f4b9695af7c22c68b5822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant: admin Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-Tenant-Name: admin Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User: admin Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Domain-Id: default Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Domain-Name: Default Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Id: 7ecff1fbd79248b7bcd1e69035be3515 Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: X-User-Name: admin Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: method: > Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: exception: Flavor 451 could not be found. Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: action_args: {'id': '451'} Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:26:32.384862 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:32.385686 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.386795 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-19c78a6c-ee5b-4d17-8cde-af7d82fcb3c0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:26:32.387786 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-19c78a6c-ee5b-4d17-8cde-af7d82fcb3c0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389129 Sep 26 10:26:32.387786 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 25/49] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 10:26:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:32.394508 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-64445956-00ea-4bf8-82ac-0f535a9c1cd1 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:32.409119 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-64445956-00ea-4bf8-82ac-0f535a9c1cd1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018170 Sep 26 10:26:32.409649 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 25/50] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 10:26:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:26:32.419143 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:32.434210 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019011 Sep 26 10:26:32.434714 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 26/51] 10.222.0.49 () {60 vars in 1210 bytes} [Mon Sep 26 10:26:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:26:32.443418 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-d132f8e7-6d59-482c-8c31-01a1c2c181b0 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:32.448245 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.wsgi [None req-d132f8e7-6d59-482c-8c31-01a1c2c181b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-d132f8e7-6d59-482c-8c31-01a1c2c181b0 admin admin] Request method failure captured: Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Accept: application/json Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Accept-Encoding: gzip, deflate Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Connection: keep-alive Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Content-Length: 0 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Host: 10.222.0.49 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Openstack-Api-Version: compute 2.92 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Openstack-System-Scope: None Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: User-Agent: python-novaclient Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Auth-Token: gAAAAABjMX5XGLCFw8c18XRmjPbKMRe59DJQyFeGVwlrChd2VK_r54BoNqLwyHcIdEmE3urV6z7K5U3ChJy8VZTFbEhhGHAdX37zf7WDgy9G-2R5PbLOiaE_w8P-DBl3hv0xcfpSz0yXU6zV04WMr9IVeBTflDaovwUxjSfeKl9MNieKuzH7xb8 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Domain-Id: None Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Domain-Name: None Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Identity-Status: Confirmed Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Is-Admin-Project: True Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Openstack-Nova-Api-Version: 2.92 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Domain-Id: default Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Domain-Name: Default Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Project-Name: admin Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Role: reader,admin,member Sep 26 10:26:32.449729 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Roles: reader,admin,member Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9cef67c15d1f4b9695af7c22c68b5822", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9cef67c15d1f4b9695af7c22c68b5822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant: admin Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant-Id: 9cef67c15d1f4b9695af7c22c68b5822 Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-Tenant-Name: admin Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User: admin Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Domain-Id: default Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Domain-Name: Default Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Id: 7ecff1fbd79248b7bcd1e69035be3515 Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: X-User-Name: admin Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: method: > Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: exception: Flavor 451 could not be found. Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: action_args: {'id': '451'} Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:26:32.451232 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:32.452191 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: ERROR nova.api.openstack.wsgi Sep 26 10:26:32.453670 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-d132f8e7-6d59-482c-8c31-01a1c2c181b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:26:32.455291 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-d132f8e7-6d59-482c-8c31-01a1c2c181b0 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011070 Sep 26 10:26:32.455291 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 26/52] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 10:26:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 26 10:26:33.653911 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:33.654942 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 26 10:26:33.655334 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:34.183038 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-655b6823-3c46-4828-969d-f34d5ffc2cfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:34.202257 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-655b6823-3c46-4828-969d-f34d5ffc2cfb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.404873 Sep 26 10:26:34.202923 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 27/54] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 10:26:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:26:35.424231 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:35.425236 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 26 10:26:35.425635 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 28/55] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:35.951004 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-7fb234c5-32ef-48c0-9270-0be919ddf790 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:35.969590 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-7fb234c5-32ef-48c0-9270-0be919ddf790 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405696 Sep 26 10:26:35.970290 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 28/56] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 10:26:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:26:37.198614 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:37.199608 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 26 10:26:37.200001 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 29/57] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:37.722977 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-8f9ab368-93d7-44c7-910d-636e1b4fb4ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:37.741088 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-8f9ab368-93d7-44c7-910d-636e1b4fb4ac admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.404804 Sep 26 10:26:37.741630 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 29/58] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 10:26:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:26:38.959064 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:38.960052 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 26 10:26:38.960442 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 30/59] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:39.478062 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-0029f4e1-3b1b-49c9-b656-4874698db674 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:26:39.496666 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-0029f4e1-3b1b-49c9-b656-4874698db674 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397282 Sep 26 10:26:39.497208 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 30/60] 10.222.0.49 () {64 vars in 1235 bytes} [Mon Sep 26 10:26:39 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:26:40.716967 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:40.717960 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 26 10:26:40.718400 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 31/61] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:26:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:26:41.243086 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-ba2a62db-835c-46ce-a14a-98b72715ae83 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:26:41.264421 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-ba2a62db-835c-46ce-a14a-98b72715ae83 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.410774 Sep 26 10:26:41.264946 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 31/62] 10.222.0.49 () {60 vars in 1202 bytes} [Mon Sep 26 10:26:40 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:27:37.466016 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:27:37.467230 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf5d732e-cd12-41e8-bb8c-40e8f32dcf1c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Sep 26 10:27:37.467619 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 931 bytes} [Mon Sep 26 10:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:27:37.478654 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:37.866377 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-624f8d5d-5791-4a70-9696-8f97da0e5a89 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:27:37.887081 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-624f8d5d-5791-4a70-9696-8f97da0e5a89 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.413447 Sep 26 10:27:37.887923 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 32/64] 10.222.0.49 () {60 vars in 1292 bytes} [Mon Sep 26 10:27:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:27:37.908878 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=14 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:27:37.912592 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-0aa80fc7-4bc5-4f9f-88be-0c94eec73576 admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:27:37.920435 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-0aa80fc7-4bc5-4f9f-88be-0c94eec73576 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013063 Sep 26 10:27:37.920946 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 33/65] 10.222.0.49 () {60 vars in 1283 bytes} [Mon Sep 26 10:27:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:27:37.932352 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-914a1095-d053-410f-8167-0e9aaee2c7ba admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:27:37.939541 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-914a1095-d053-410f-8167-0e9aaee2c7ba admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010821 Sep 26 10:27:37.940057 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 33/66] 10.222.0.49 () {60 vars in 1286 bytes} [Mon Sep 26 10:27:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:27:37.951723 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:27:37.958920 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010799 Sep 26 10:27:37.959436 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 34/67] 10.222.0.49 () {60 vars in 1286 bytes} [Mon Sep 26 10:27:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:27:37.971220 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-a112dcce-db6c-4238-98cb-919c7dbd890f admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:27:37.978924 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-a112dcce-db6c-4238-98cb-919c7dbd890f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010562 Sep 26 10:27:37.979439 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 34/68] 10.222.0.49 () {60 vars in 1283 bytes} [Mon Sep 26 10:27:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:30:35.048935 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:35.049940 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 26 10:30:35.050545 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:30:35.196784 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=6 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:30:35.363745 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:35.368718 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:35.369230 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:35.369779 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:35.370476 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:35.370950 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:35.371386 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:35.405467 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-373f177e-5b5e-497c-a01a-2dc27f7d6562 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.210014 Sep 26 10:30:35.406089 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 35/70] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 10:30:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:30:36.516074 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:36.517084 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 26 10:30:36.517491 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:30:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:30:36.716957 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:36.724000 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:36.724484 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:36.724919 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:36.725669 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:36.726255 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:36.726680 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:36.746872 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-3e6bceb3-5309-423f-89c9-4618e98a1eab admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.087844 Sep 26 10:30:36.747446 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 36/72] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 10:30:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:30:48.389539 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:48.390577 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 26 10:30:48.390975 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 37/73] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:30:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:30:48.534554 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell0:SELECT=4 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:30:48.535274 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_cell1:SELECT=4 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:30:48.535913 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG dbcounter [-] [105399] Writing DB stats nova_api:SELECT=8 {{(pid=105399) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:30:48.584093 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:48.587552 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:48.588026 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:48.588449 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:48.589159 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:48.590132 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:48.590545 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:48.617360 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-61c2cdc1-5659-4293-b19f-bd14df9543bb admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087163 Sep 26 10:30:48.617840 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 37/74] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 10:30:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:30:49.706849 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG nova.api.openstack.wsgi [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] Calling method '>' {{(pid=105398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:49.707880 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: INFO nova.api.openstack.requestlog [None req-bf48e6f9-99ed-4759-863b-bb5a29d3468d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001826 Sep 26 10:30:49.708272 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: [pid: 105398|app: 0|req: 38/75] 10.222.0.49 () {56 vars in 1074 bytes} [Mon Sep 26 10:30:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:30:49.903581 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG nova.api.openstack.wsgi [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Calling method '>' {{(pid=105399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:30:49.906957 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:49.907449 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:49.907895 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:49.908602 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:30:49.909041 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:30:49.909451 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: DEBUG oslo_concurrency.lockutils [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:30:49.931153 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: INFO nova.api.openstack.requestlog [None req-1587d26b-af76-480f-9a26-0a2a813dce5e admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079724 Sep 26 10:30:49.931627 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: [pid: 105399|app: 0|req: 38/76] 10.222.0.49 () {60 vars in 1193 bytes} [Mon Sep 26 10:30:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:31:48.434425 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: Mon Sep 26 10:31:48 2022 - graceful shutdown triggered... Sep 26 10:31:48.435134 dv-cinder-844563-7-iscsi devstack@n-api.service[105399]: Gracefully killing worker 2 (pid: 105399)... Sep 26 10:31:48.434557 dv-cinder-844563-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 26 10:31:48.436003 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: Gracefully killing worker 1 (pid: 105398)... Sep 26 10:31:48.561655 dv-cinder-844563-7-iscsi devstack@n-api.service[105398]: DEBUG dbcounter [-] [105398] Writing DB stats nova_api:SELECT=4 {{(pid=105398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:31:49.435138 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: worker 1 buried after 1 seconds Sep 26 10:31:49.435700 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: worker 2 buried after 1 seconds Sep 26 10:31:49.435700 dv-cinder-844563-7-iscsi devstack@n-api.service[105397]: goodbye to uWSGI. Sep 26 10:31:49.436768 dv-cinder-844563-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 26 10:31:49.437307 dv-cinder-844563-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 26 10:31:49.440124 dv-cinder-844563-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 26 10:31:49.449758 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 10:31:49 2022] *** Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: nodename: dv-cinder-844563-7-iscsi Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: machine: x86_64 Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: clock source: unix Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: pcre jit disabled Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: detected number of CPU cores: 4 Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: current working directory: / Sep 26 10:31:49.451899 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: detected binary path: /usr/bin/uwsgi-core Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: your processes number limit is 47680 Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: your memory page size is 4096 bytes Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: detected max file descriptor number: 2048 Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: lock engine: pthread robust mutexes Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: thunder lock: enabled Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 26 10:31:49.452547 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 10:31:49.497365 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: Python main interpreter initialized at 0x55a518da69c0 Sep 26 10:31:49.497365 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: python threads support enabled Sep 26 10:31:49.497365 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: your server socket listen backlog is limited to 100 connections Sep 26 10:31:49.497365 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: your mercy for graceful operations on workers is 90 seconds Sep 26 10:31:49.497847 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 10:31:49.497847 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: *** Operational MODE: preforking *** Sep 26 10:31:49.498277 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: *** uWSGI is running in multiple interpreter mode *** Sep 26 10:31:49.498442 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: spawned uWSGI master process (pid: 127037) Sep 26 10:31:49.498789 dv-cinder-844563-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 26 10:31:49.501984 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: spawned uWSGI worker 1 (pid: 127055, cores: 1) Sep 26 10:31:49.501984 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: spawned uWSGI worker 2 (pid: 127056, cores: 1) Sep 26 10:31:49.501984 dv-cinder-844563-7-iscsi devstack@n-api.service[127037]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 10:31:50.161819 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 10:31:50.170303 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 26 10:31:51.323194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:31:51.323194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: from cryptography.utils import int_from_bytes Sep 26 10:31:51.324333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:31:51.324333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: from cryptography.utils import int_from_bytes Sep 26 10:31:51.340444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:31:51.340444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: from cryptography.utils import int_from_bytes Sep 26 10:31:51.341013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 10:31:51.341013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: from cryptography.utils import int_from_bytes Sep 26 10:31:53.751251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 10:31:53.751848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 10:31:53.752154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 10:31:53.752432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 10:31:53.752694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 10:31:53.753088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.753419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.753748 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.754096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.754437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.754756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.755084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.755416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.755742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.756017 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.756330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.756830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-7-iscsi {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.757164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.757482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.757802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.758153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.758466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.758793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.759107 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.759616 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.761596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.761596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.761596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.761596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.761909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.762190 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.762519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.762837 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.763162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.763543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.763897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-7-iscsi {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.764227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.764537 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.764854 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.765288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.765605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.765932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.766272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.766595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.766912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.767250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.767572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.767892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.768218 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.768530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.768836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.769144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.769472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.769780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.770121 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.770376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.770689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.771023 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.771338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.771663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.771934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.772166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.772486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.772809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.773120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.773431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.773740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.774103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.774376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.774682 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.775006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.775309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.775627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.775945 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.776268 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.777145 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.777469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.777882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.778161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.778473 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.778830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.779139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.779449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.779772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.780098 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.780416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.780725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.781048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.781357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.781695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.782005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.782280 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.782585 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.782860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 10:31:53.783298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.783385 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 10:31:53.783485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.783485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.783759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 10:31:53.783858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.784032 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 10:31:53.784142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.784309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 10:31:53.784412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.784674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.784783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.784990 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.785172 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.785362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.785543 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.785696 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.785846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.785997 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.786205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.786357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.786554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.786707 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.786859 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787001 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787312 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787464 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787776 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.787932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.788085 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.788307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.788452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844563-7-iscsi {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.788595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.788744 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.788886 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.789956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.790132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.790276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.790438 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.790598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.790741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.790890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791032 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791199 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791546 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.791987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.792135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.792291 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.792441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.792584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.792725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.792866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.793015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.793169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.793322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.793469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.794967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.798722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.798935 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.799107 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.799257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.799402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.799632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844563-7-iscsi {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.799797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.799962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.800117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.800280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.800431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.800575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.800731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.800731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.801020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.801174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.801318 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.801478 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.801640 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.802159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.802326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.802471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.802625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.802769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.802921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.805648 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.805833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.805998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.806186 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.806347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.809951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.810180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.810334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.810491 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.810636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.810812 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.810960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.811112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.811262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.811413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.811556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.811714 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.811864 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.812067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.812224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.812224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.812495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.812666 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.812811 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.812961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.813102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.813243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.813398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.813398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.813676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.813676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.813964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.814141 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.814297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.814462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.816892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.817661 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.817832 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.817991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.818191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.818347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.818499 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.818652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.818807 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.818951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.819113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.819257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.819398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.819555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.819711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.819902 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.820059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.820210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.820359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.820503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.820654 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.820805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.820947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.821101 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.821243 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.822229 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.822408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.822557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.822706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.822857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.823001 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.823153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.823796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.824096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.824402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.825395 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.825566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.825726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.825879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.826049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.826209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.826361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.826511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.826663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.826814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.827052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.827274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.827424 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.827582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.827743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.827893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.828045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.828196 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.828346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.828503 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.828655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.828797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.828948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.829098 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.829248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.829248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.829538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.829538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.829822 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.829822 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.830181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.830480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.830630 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.831354 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.831535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.831842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.831994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.832151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.832409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.832409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.832718 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.832871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.833023 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.833173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.833328 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.833471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.833613 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.833613 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.833986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.834235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.834392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.834544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.834698 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.834848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.835004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.835166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.835649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.835817 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.836010 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.836157 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.836309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.836466 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.836619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.836769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.836910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.837073 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.837223 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.837472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.837623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.837623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.837917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.837917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.838245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.838388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.838540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.838540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.838835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.838835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.839678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.839875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.840075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.840075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.840374 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.840606 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.840765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.841061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.841212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.841367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.841511 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.841654 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.842002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.842186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.842332 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.842590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.842748 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.842891 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.843041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.843183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.843325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.843325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.843614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.843763 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.843907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.844067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.844219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.844370 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.844520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.844669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.844811 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.844954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.845104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.845257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.845687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.845842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.845986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.846164 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.846345 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.846752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.846903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.847047 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.847195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.847338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.847582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.847733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 10:31:53.847882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.847882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.848314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.848465 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.848608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.848762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.848906 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849491 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.849935 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.850192 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.850353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.850534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.850784 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.850942 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.851086 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.851230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.851386 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.851538 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.851681 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.851824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.852138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.852369 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.852530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.852785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.852785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853076 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853076 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853076 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853657 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.853955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.854270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.854415 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.854601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.854756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.854898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.855060 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.855217 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.855360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.855891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856659 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.856953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.857095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.857263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.857263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.857645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.857806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.857960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.858154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.858309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.858462 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.858613 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.858764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.858914 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859374 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.859971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.860114 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.860300 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.860451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.860601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.860840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.861002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.861147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.861289 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.861449 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.861738 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.861896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.862245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.862401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.862552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.862798 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.862960 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.863111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.863336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.863336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.863616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.863760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.863913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.864333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.864480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.864621 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.864770 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.864921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.865071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.865226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.865370 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.865510 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.865944 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.866125 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.866279 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.866448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.866600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.866753 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.866896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.867053 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.867197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.867353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.867497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.867638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.867893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868202 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868370 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868673 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.868971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.869272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.869428 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.869577 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.869733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.869881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.870074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.870316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.870482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.870641 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.870816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871695 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.871989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.872346 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.872521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.872689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.872961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.873120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.873281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.873440 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.873589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.873737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.873893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.874064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.874232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.874392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.874548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.874705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.874862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.875033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.875198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.875356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.875514 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.875670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.876105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.876263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.876424 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.876673 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.876855 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.877006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.877006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.877308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.877459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.877607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.877858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878199 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878362 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878526 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878832 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.878981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.879136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.879297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.879457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.879607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.879764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.879913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.880060 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.880223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.880425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.880592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.880750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.880901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.881155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.881320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.881575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.881752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.881911 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.882128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.882389 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.882646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.882646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.882951 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.883220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.883492 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.883660 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.883812 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.884566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.884725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.884892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.885050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.885201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.885358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.885516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.885676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.886622 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.886788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.886948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.887101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.887260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.887427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.887576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.887739 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.887920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.888164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.888319 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.888476 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.888476 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.888778 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.888938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.889095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.889243 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.889404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.889552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.889710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.889859 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.890008 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.890225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.890384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.890593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.890758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.890907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.891067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.891317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.891481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.891652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.891810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.891968 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.892127 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.892276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.892523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.892706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.892962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.893138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.893400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.893554 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.893710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.893868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.894049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.894217 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.894217 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.894510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.894666 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.894901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.895976 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.896143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.896294 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.896462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.896948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.897113 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.897264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.897633 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.897734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.897843 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.897945 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898373 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898466 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898558 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898735 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898888 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.898968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899127 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899203 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899835 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.899919 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900293 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900293 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.900960 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.901057 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.901142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.901225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.901331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.901468 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902228 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902380 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902789 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902862 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.902948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903025 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903175 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903763 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.903842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904037 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904109 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904178 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904737 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.904925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905589 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.905935 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906016 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906214 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.906655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907168 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907794 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907887 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.907983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908150 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908419 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908492 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.908895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909537 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909702 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909904 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.909996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910501 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910727 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.910917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911175 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911260 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.911982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912071 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912254 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912254 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912514 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.912737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913491 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.913946 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914661 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914754 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914838 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.914934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915108 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915192 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915526 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915898 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.915987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916177 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916268 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916359 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916539 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.916801 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.917636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.917740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.917836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.917922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918717 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918717 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.918970 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919055 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919146 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919226 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919659 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.919926 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920016 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920190 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.920918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921011 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921185 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921884 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.921964 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922200 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922275 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.922948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923020 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923182 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923253 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.923950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924037 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924218 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924291 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924363 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.924916 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925099 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925801 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.925989 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927368 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927477 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927589 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927778 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927863 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.927957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928321 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928413 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.928956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929138 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929312 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929660 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929751 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929845 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.929936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930092 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930409 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930483 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930634 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930850 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.930934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931013 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931236 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931315 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931757 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.931978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932379 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.932622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933244 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933585 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933683 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.933868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934303 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934303 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.934951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.935101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.935251 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.935454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.935576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.935769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.935898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.936079 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.936223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.936387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.936548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.936695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.936874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937019 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937200 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937641 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.937962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.938202 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.938306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.938529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.938633 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.938854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.938948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.939171 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.939264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.939493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.939595 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.939818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.939920 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.940129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.940235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.940455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.940547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.940772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.940871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.941087 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.941196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.941402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.941500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.941717 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.941851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.942054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.942201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.942379 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.942528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.942697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.942846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943012 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943495 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943651 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.943973 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.944157 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.944472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.944613 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.944868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945467 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945784 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.945925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.946149 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.946243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.946437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.946538 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.946753 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.946853 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.947070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.947163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.947387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.947493 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.947699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.947801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.948012 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.948113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.948393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.948978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.949216 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.949322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.949551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.949650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.949872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.949989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.950227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.950352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.950550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.950676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.950873 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.951078 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.951234 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.951401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.951574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.951720 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.951869 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.952046 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.952196 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.952383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.952475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.952773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.952931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.953088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.953243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.953407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.953548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.953705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.953846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954152 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954366 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.954996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.955102 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.955309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.955401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.955640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.955732 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.955973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.956085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.956297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.956395 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.956615 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.956716 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.956933 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.957041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.957252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.957427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.957692 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.957791 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.958069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.958179 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.958388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.958488 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.958710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.958816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959121 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959354 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959673 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959774 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.959999 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.960096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.960308 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.960408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.960620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.960751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.960935 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.961958 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.962227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.962538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.962807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.962919 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.963157 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.963257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.963481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.963697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.963822 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.964127 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.964284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.964400 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.964555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.964738 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.964959 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.965196 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.965350 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.965498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.965646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.965784 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.965937 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.966908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.967079 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.967225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.967399 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.967535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.967736 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.967829 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.968080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.968172 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.968420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.968526 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.968740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.968834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.969056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.969146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.969364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.969455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.969697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.969780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.970007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.970363 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.970724 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.970989 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.971297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.971864 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.972177 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.972484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.972879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.973109 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.973684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.973794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.973872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.974147 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.974739 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.974841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.975116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.975519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.976332 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.976332 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.976943 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.977924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.978256 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.978398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.978611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.978742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.979078 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.979400 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.979647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.979808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.980164 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.980269 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.980477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.980923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.981306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.981516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.981896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.982138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.982490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.982855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.983095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.983258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.983458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.983561 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.983876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.983991 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.984246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.984366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.984575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.984730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.984885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.985164 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.985355 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.985631 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.985768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.985928 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.986116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.986116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.986349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.986508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.986726 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.987073 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.987412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.987556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.987782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.987886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.988163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.988287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.988498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.988603 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.988822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.988931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.989232 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.989340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.989439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.989757 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.990094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.990198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.990418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.990512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.990753 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.990954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.991062 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.991156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.991387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.991504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.991800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.992109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.992213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.992429 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.992521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.992756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.992858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.993072 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.993180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.993400 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.993505 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.993721 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.993825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.994061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.994353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.994447 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.994684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.994783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.995017 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.995658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.995886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.995990 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.996218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.996319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.996544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.996642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.996853 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.996947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.997159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.997255 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.997466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.997565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.997797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.997899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.998141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.998266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.998454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.998548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.998762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.998864 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999168 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999381 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999474 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:53.999991 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.000125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.000296 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.000434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.000601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.000765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.000912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.001140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.001260 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.001473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.001679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.001785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.001877 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.002114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.002243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.002440 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.002546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.002729 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.002830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003344 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003448 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.003964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004065 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004362 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.004987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.005224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.005324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.005541 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.005643 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.005872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.005983 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.006204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.006319 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.006526 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.006619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.006838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.006940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.007159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.007256 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.007480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.007736 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.007836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.008058 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.008153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.008409 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.008517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.008718 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.008820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.009978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.010105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.010315 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.010414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.010644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.010765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.011523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.011632 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.011834 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.011925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.012154 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.012255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.012472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.012563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.012792 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.012883 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.013105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.013209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.013417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.013508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.013793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.013892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.014088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.014343 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.014445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.014706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.014799 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015120 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.015962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.016060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.016278 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.016403 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.016598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.016750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.016906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.017048 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.017227 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.017394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.017540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.017810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.017962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.018174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.018332 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.018496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.018677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.018814 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.018969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.019130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.019280 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.019455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.019597 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.019781 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.019929 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020071 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020227 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020388 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.020971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 10:31:54.021116 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.021343 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.021663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.021984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.022329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.022646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.022965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.023282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.023606 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.023922 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.024344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.024662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.024988 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.025355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.025679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.025996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.026404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.026708 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.027027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.027357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.027681 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.028014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.028337 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.028664 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.029022 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.029354 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.029905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.030275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.030616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.030962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.031306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.031626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.031944 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.032262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.032600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.032924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.033249 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.033570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.033891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.034237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.034561 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.034882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.035201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.035520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.035839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.036162 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.036492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.036800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.037121 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.037446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.037797 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.038151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.038483 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.038817 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.039143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.039464 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.039784 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.040279 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.040616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.040945 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.041289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.041616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.041977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.042556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.042915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.043253 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.043587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.043911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.044248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.044580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.044905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.045239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.045561 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.045903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.046279 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.046622 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.046955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.047270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.047586 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.047902 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.048224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.048557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.048879 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.049193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.049507 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.049829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.050167 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.050513 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.050828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.051143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.051464 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.051777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.052091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.052405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.052766 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.053059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.053372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.053718 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.054058 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.054370 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.054685 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.055002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.055314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.055655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.056027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.056353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.056691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.057014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.057344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.058192 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.058532 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.058866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.059193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.059515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.059863 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.060186 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.060515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.060839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.061162 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.061485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.061805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.062163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.062503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.062819 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.063153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.063481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.063838 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.064166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.064488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.064828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.065150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.065470 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.065791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.066137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.066478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.066787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.067110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.067430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.067757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.068084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.068422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.068760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.069083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.069423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.069757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.070132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.070465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.070821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.071158 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.071483 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.071807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.072124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 10:31:54.072801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 10:31:54.082759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO dbcounter [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Registered counter for database nova_api Sep 26 10:31:54.102969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_db.sqlalchemy.engines [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.109535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writer thread running {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.136647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO dbcounter [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Registered counter for database nova_api Sep 26 10:31:54.156426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.162890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writer thread running {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.165441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.context [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e066cc03-4cbd-4f04-8c08-1a760e88bbb8(cell1) {{(pid=127055) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 10:31:54.169490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:31:54.169968 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:31:54.171565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:31:54.172296 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:31:54.172743 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:31:54.174770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:31:54.176735 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO dbcounter [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Registered counter for database nova_cell0 Sep 26 10:31:54.180773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO dbcounter [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Registered counter for database nova_cell1 Sep 26 10:31:54.189463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_db.sqlalchemy.engines [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.190130 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_db.sqlalchemy.engines [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.196231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writer thread running {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.197504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writer thread running {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.220853 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.context [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e066cc03-4cbd-4f04-8c08-1a760e88bbb8(cell1) {{(pid=127056) load_cells /opt/stack/nova/nova/context.py:464}} Sep 26 10:31:54.225170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:31:54.225651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:31:54.227262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:31:54.228000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:31:54.228451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:31:54.230534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:31:54.232511 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO dbcounter [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Registered counter for database nova_cell0 Sep 26 10:31:54.236524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO dbcounter [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Registered counter for database nova_cell1 Sep 26 10:31:54.243425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.246144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.250714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writer thread running {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.253848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writer thread running {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.344639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO dbcounter [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Registered counter for database nova_cell0 Sep 26 10:31:54.351376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_db.sqlalchemy.engines [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.356231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writer thread running {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.401442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO dbcounter [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Registered counter for database nova_cell0 Sep 26 10:31:54.408340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_db.sqlalchemy.engines [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 10:31:54.412780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writer thread running {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 10:31:54.674560 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: WARNING keystonemiddleware.auth_token [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:31:54.681699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: WARNING keystonemiddleware.auth_token [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:31:54.731320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: WARNING keystonemiddleware.auth_token [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:31:54.738607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: WARNING keystonemiddleware.auth_token [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:31:55.029977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: WARNING keystonemiddleware.auth_token [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:31:55.036485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: WARNING keystonemiddleware.auth_token [None req-84422b39-47a6-4921-8ffe-07c181624b84 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:31:55.041782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a518da69c0 pid: 127055 (default app) Sep 26 10:31:55.092090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: WARNING keystonemiddleware.auth_token [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 26 10:31:55.098406 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: WARNING keystonemiddleware.auth_token [None req-0ff9316c-32e1-40d5-9bd2-614b5773c675 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 26 10:31:55.103760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a518da69c0 pid: 127056 (default app) Sep 26 10:32:31.041279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.044120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.045120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.046097 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.242480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.244280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.247049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:31.248800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:32.382920 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-392dda82-c3da-4507-ae25-19abf9872e3a tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Action: 'create', calling method: .version_select at 0x7fbadc1fd430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-29104650"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:32.653223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0275c2a5-4e6f-448d-9244-c004af41e78b tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Action: 'create', calling method: .version_select at 0x7fbadc1ff430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2045001897", "metadata": {"Type": "work"}}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0275c2a5-4e6f-448d-9244-c004af41e78b tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Request method failure captured: Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 122 Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX-_rOHz4MrFjR79i8JsuPswZGTdeyZr_gELnK6TGniOC05dx58U4et34mOigCxbFzwkgAqvYhru0QS9t9aQGrCQ8kccjIbO8jJyxqknqmGeZ_mvzaZSnYRY_tLojZmim6FRO4HcNf0Xsll7ptbXYBnOmf4luBpvryaEJeKXCas0TNI Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:32.664434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8472411865af4f63b0d54d57ce2aa31a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 4099fa631da548508b1a196887a9160e Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2045001897", "metadata": {"Type": "work"}}} Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:32.666166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2045001897', 'metadata': {'Type': 'work'}}}} Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise error Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi '#$%' Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:32.667706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 10:32:32.669306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 10:32:32.670714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 26 10:32:32.670714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.670714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0275c2a5-4e6f-448d-9244-c004af41e78b tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:32.671623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0275c2a5-4e6f-448d-9244-c004af41e78b tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.435195 Sep 26 10:32:32.672664 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 10:32:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 10:32:32.689489 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d7b47f4f-820c-4dd2-975b-ac7c28fe39fe tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Action: 'create', calling method: .version_select at 0x7fbadc1ffd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1229678292", "metadata": {"Type": "work"}}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d7b47f4f-820c-4dd2-975b-ac7c28fe39fe tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Request method failure captured: Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 120 Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX-_rOHz4MrFjR79i8JsuPswZGTdeyZr_gELnK6TGniOC05dx58U4et34mOigCxbFzwkgAqvYhru0QS9t9aQGrCQ8kccjIbO8jJyxqknqmGeZ_mvzaZSnYRY_tLojZmim6FRO4HcNf0Xsll7ptbXYBnOmf4luBpvryaEJeKXCas0TNI Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:32.695800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8472411865af4f63b0d54d57ce2aa31a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 4099fa631da548508b1a196887a9160e Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1229678292", "metadata": {"Type": "work"}}} Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:32.697434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1229678292', 'metadata': {'Type': 'work'}}}} Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise error Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi '0' Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:32.698396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 10:32:32.699930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 10:32:32.701247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 26 10:32:32.701247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.702904 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d7b47f4f-820c-4dd2-975b-ac7c28fe39fe tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:32.707013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d7b47f4f-820c-4dd2-975b-ac7c28fe39fe tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024900 Sep 26 10:32:32.708163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 2/2] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 10:32:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 10:32:32.724737 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8c4d8f17-4fa3-43eb-87db-283845e4b3d5 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Action: 'create', calling method: .version_select at 0x7fbadc0b8160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-176676297", "metadata": {"Type": "work"}}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8c4d8f17-4fa3-43eb-87db-283845e4b3d5 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Request method failure captured: Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 118 Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX-_rOHz4MrFjR79i8JsuPswZGTdeyZr_gELnK6TGniOC05dx58U4et34mOigCxbFzwkgAqvYhru0QS9t9aQGrCQ8kccjIbO8jJyxqknqmGeZ_mvzaZSnYRY_tLojZmim6FRO4HcNf0Xsll7ptbXYBnOmf4luBpvryaEJeKXCas0TNI Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:32.738372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8472411865af4f63b0d54d57ce2aa31a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 4099fa631da548508b1a196887a9160e Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-176676297", "metadata": {"Type": "work"}}} Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:32.739957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-176676297', 'metadata': {'Type': 'work'}}}} Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise error Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi '' Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:32.740931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 26 10:32:32.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 26 10:32:32.743964 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 26 10:32:32.743964 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:32.744358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8c4d8f17-4fa3-43eb-87db-283845e4b3d5 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:32.747567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8c4d8f17-4fa3-43eb-87db-283845e4b3d5 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031850 Sep 26 10:32:32.751656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 3/3] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 10:32:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 10:32:32.762441 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-da7b2832-a506-482b-a566-78710a42c1c8 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Calling method '.version_select at 0x7fbadc0b8c10>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:33.312878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-da7b2832-a506-482b-a566-78710a42c1c8 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] HTTP exception thrown: Volume tempest-invalid-49022155 could not be found. Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-da7b2832-a506-482b-a566-78710a42c1c8 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Request method failure captured: Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-49022155 HTTP/1.1 Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX-_rOHz4MrFjR79i8JsuPswZGTdeyZr_gELnK6TGniOC05dx58U4et34mOigCxbFzwkgAqvYhru0QS9t9aQGrCQ8kccjIbO8jJyxqknqmGeZ_mvzaZSnYRY_tLojZmim6FRO4HcNf0Xsll7ptbXYBnOmf4luBpvryaEJeKXCas0TNI Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:33.317907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8472411865af4f63b0d54d57ce2aa31a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 4099fa631da548508b1a196887a9160e Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Volume tempest-invalid-49022155 could not be found. Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': 'tempest-invalid-49022155'} Sep 26 10:32:33.319508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-49022155 could not be found. (HTTP 404) (Request-ID: req-b98a7868-26b1-4719-8a66-4fe8f411d6ea) Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.320475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 10:32:33.321851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-49022155 could not be found. Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:33.323281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-49022155 could not be found. Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-49022155 could not be found. Sep 26 10:32:33.324689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.328537 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-da7b2832-a506-482b-a566-78710a42c1c8 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Returning 404 to user: Volume tempest-invalid-49022155 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:33.329903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-da7b2832-a506-482b-a566-78710a42c1c8 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-49022155" status: 404 len: 97 microversion: 2.1 time: 0.573206 Sep 26 10:32:33.330770 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1212 bytes} [Mon Sep 26 10:32:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-49022155 => generated 97 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 26 10:32:33.355371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8114c65b-7eff-432d-958c-fdf704907ebb tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013504 Sep 26 10:32:33.356304 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 5/5] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Sep 26 10:32:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 10:32:33.373653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-25720813-949d-48ec-b8d0-c31b567de9f1 tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011606 Sep 26 10:32:33.379875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 6/6] 10.222.0.49 () {58 vars in 1137 bytes} [Mon Sep 26 10:32:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 26 10:32:33.390273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-050c20d2-48f7-4451-a562-08260e7dc4cd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Calling method '.version_select at 0x7fbadbff03a0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:33.618874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-050c20d2-48f7-4451-a562-08260e7dc4cd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] HTTP exception thrown: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-050c20d2-48f7-4451-a562-08260e7dc4cd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Request method failure captured: Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/os-volumes/2c30efbf-495d-4fb9-b8c7-a110c6c02320 HTTP/1.1 Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX-_rOHz4MrFjR79i8JsuPswZGTdeyZr_gELnK6TGniOC05dx58U4et34mOigCxbFzwkgAqvYhru0QS9t9aQGrCQ8kccjIbO8jJyxqknqmGeZ_mvzaZSnYRY_tLojZmim6FRO4HcNf0Xsll7ptbXYBnOmf4luBpvryaEJeKXCas0TNI Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:33.622469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8472411865af4f63b0d54d57ce2aa31a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 4099fa631da548508b1a196887a9160e Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '2c30efbf-495d-4fb9-b8c7-a110c6c02320'} Sep 26 10:32:33.624030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. (HTTP 404) (Request-ID: req-f27db252-c012-452b-ac03-1ff213ccfa50) Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.624972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 10:32:33.626402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 10:32:33.627847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.629826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-050c20d2-48f7-4451-a562-08260e7dc4cd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Returning 404 to user: Volume 2c30efbf-495d-4fb9-b8c7-a110c6c02320 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:33.631663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-050c20d2-48f7-4451-a562-08260e7dc4cd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/2c30efbf-495d-4fb9-b8c7-a110c6c02320" status: 404 len: 109 microversion: 2.1 time: 0.245460 Sep 26 10:32:33.631663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 7/7] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:32:33 2022] DELETE /compute/v2.1/os-volumes/2c30efbf-495d-4fb9-b8c7-a110c6c02320 => generated 109 bytes in 247 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:32:33.646698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a925df75-1061-4a0b-9674-0e7be57d10bd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Calling method '.version_select at 0x7fbadbff0280>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:33.775251 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-a925df75-1061-4a0b-9674-0e7be57d10bd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] HTTP exception thrown: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a925df75-1061-4a0b-9674-0e7be57d10bd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Request method failure captured: Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/os-volumes/d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 HTTP/1.1 Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX-_rOHz4MrFjR79i8JsuPswZGTdeyZr_gELnK6TGniOC05dx58U4et34mOigCxbFzwkgAqvYhru0QS9t9aQGrCQ8kccjIbO8jJyxqknqmGeZ_mvzaZSnYRY_tLojZmim6FRO4HcNf0Xsll7ptbXYBnOmf4luBpvryaEJeKXCas0TNI Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:33.778584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8472411865af4f63b0d54d57ce2aa31a", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8472411865af4f63b0d54d57ce2aa31a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 8472411865af4f63b0d54d57ce2aa31a Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesNegativeTest-456739436 Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 4099fa631da548508b1a196887a9160e Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesNegativeTest-456739436-project Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': 'd5c9dda6-53ad-460d-8de4-8ff04a2b3ed0'} Sep 26 10:32:33.779915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. (HTTP 404) (Request-ID: req-4573c72b-b957-4752-a96e-2f74407bb923) Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.780662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:33.781815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 10:32:33.783066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. Sep 26 10:32:33.784205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:33.788502 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a925df75-1061-4a0b-9674-0e7be57d10bd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] Returning 404 to user: Volume d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:33.789734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a925df75-1061-4a0b-9674-0e7be57d10bd tempest-VolumesNegativeTest-456739436 tempest-VolumesNegativeTest-456739436-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0" status: 404 len: 109 microversion: 2.1 time: 0.152220 Sep 26 10:32:33.800377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 8/8] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:33 2022] GET /compute/v2.1/os-volumes/d5c9dda6-53ad-460d-8de4-8ff04a2b3ed0 => generated 109 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:32:34.239961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-392dda82-c3da-4507-ae25-19abf9872e3a tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.210635 Sep 26 10:32:34.240605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 1/9] 10.222.0.49 () {60 vars in 1155 bytes} [Mon Sep 26 10:32:31 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3213 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 26 10:32:34.258083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f6271bf1-584e-413e-ba6a-a0fac0561c04 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0b8430>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:34.380448 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f6271bf1-584e-413e-ba6a-a0fac0561c04 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 200 len: 343 microversion: 2.1 time: 0.127257 Sep 26 10:32:34.381300 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 9/10] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:34 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 343 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:35.409689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0b543c4c-6373-4396-8c57-e65b84156325 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d3310>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:35.529038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0b543c4c-6373-4396-8c57-e65b84156325 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 200 len: 344 microversion: 2.1 time: 0.136135 Sep 26 10:32:35.529601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 2/11] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:35 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:35.543284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7b1c176c-8f91-44bc-8fe5-f4ae2515e02d tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Action: 'create', calling method: .version_select at 0x7fbadbff09d0>, body: {"snapshot": {"volume_id": "174d4ad7-db40-43ec-abb4-b7ba03cc564b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-752226359"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:36.101053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7b1c176c-8f91-44bc-8fe5-f4ae2515e02d tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.562243 Sep 26 10:32:36.102505 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 10/12] 10.222.0.49 () {60 vars in 1162 bytes} [Mon Sep 26 10:32:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:36.114039 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-49c56d85-71e1-4cb5-b88b-7495b1c458a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d39d0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:36.189292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-49c56d85-71e1-4cb5-b88b-7495b1c458a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 200 len: 286 microversion: 2.1 time: 0.079392 Sep 26 10:32:36.203229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 3/13] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:36 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:36.210065 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-dd907818-85eb-487c-8979-6d9f2f961c09 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc099160>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:36.318062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-dd907818-85eb-487c-8979-6d9f2f961c09 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.112911 Sep 26 10:32:36.322755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 11/14] 10.222.0.49 () {58 vars in 1140 bytes} [Mon Sep 26 10:32:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:36.333133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5762ba96-3ee8-4209-8edc-ae84b200ca77 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc06a160>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:36.400358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5762ba96-3ee8-4209-8edc-ae84b200ca77 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 200 len: 286 microversion: 2.1 time: 0.071384 Sep 26 10:32:36.405649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 4/15] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:36 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:37.412996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4f04e0a9-4680-40f4-ab50-a9614c9240d2 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0999d0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:37.581899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4f04e0a9-4680-40f4-ab50-a9614c9240d2 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 200 len: 286 microversion: 2.1 time: 0.172656 Sep 26 10:32:37.582485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 12/16] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:37 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 286 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:38.600157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4e1fa95a-0d82-4e77-9443-c7c9884e0adf tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d3ca0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:38.661869 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4e1fa95a-0d82-4e77-9443-c7c9884e0adf tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 200 len: 286 microversion: 2.1 time: 0.067954 Sep 26 10:32:38.662525 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 5/17] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:38 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:39.676137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-31313b18-afe7-45f4-ac96-a8d7b4d21555 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d35e0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:39.747049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-31313b18-afe7-45f4-ac96-a8d7b4d21555 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 200 len: 287 microversion: 2.1 time: 0.075862 Sep 26 10:32:39.747901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 6/18] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:39 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:32:39.759141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5a23ecd9-a331-41c9-977e-e4332ae074e7 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc06a280>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:39.919387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5a23ecd9-a331-41c9-977e-e4332ae074e7 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 202 len: 0 microversion: 2.1 time: 0.163807 Sep 26 10:32:39.924521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 7/19] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Sep 26 10:32:39 2022] DELETE /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:32:39.929565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7e6cf05f-b96a-44e6-a17e-18018bd1b323 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc06a8b0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:40.005439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7e6cf05f-b96a-44e6-a17e-18018bd1b323 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 200 len: 286 microversion: 2.1 time: 0.079514 Sep 26 10:32:40.006090 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 8/20] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:39 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:40.219597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-316262960", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "networks": [{"uuid": "72b0f45a-e680-4d29-a349-f6ec781d90cd"}]}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:40.447340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] validate_networks() for [('72b0f45a-e680-4d29-a349-f6ec781d90cd', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:32:41.018533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e610b65f-5394-40db-8aa4-6f7dc6bfa88c tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d3820>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:41.064193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-e610b65f-5394-40db-8aa4-6f7dc6bfa88c tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] HTTP exception thrown: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e610b65f-5394-40db-8aa4-6f7dc6bfa88c tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Request method failure captured: Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb HTTP/1.1 Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX--5NKZNkI2IPYsFJvA-B1qziJDqYS_aCZbcAdu2oXPArkGccD6RFl3Pj3NJxst84W1CWlU4HAF7210rLSUjkkxSiuzxZlfx8C5HIy24qxvMz85gsn2D-cILY4-WUd5tReMyaHroL7mpl-q7WWVLi1wVJOSPiW8Y1JyLGmRF4A0E6o Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:32:41.069061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_278d2e73018e464ab63524b9e4ebd32b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 33953f2fd2f2469e8668120ea4f9bc92 Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '4a27da2c-91c4-48b5-a2d5-53df6bb45beb'} Sep 26 10:32:41.070155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. (HTTP 404) (Request-ID: req-15bc8a02-12f9-4053-9e08-d8052f4407e7) Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.070804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:41.071667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 26 10:32:41.073327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e610b65f-5394-40db-8aa4-6f7dc6bfa88c tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Returning 404 to user: Snapshot 4a27da2c-91c4-48b5-a2d5-53df6bb45beb could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:41.075861 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e610b65f-5394-40db-8aa4-6f7dc6bfa88c tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb" status: 404 len: 111 microversion: 2.1 time: 0.056364 Sep 26 10:32:41.077540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 9/21] 10.222.0.49 () {58 vars in 1251 bytes} [Mon Sep 26 10:32:41 2022] GET /compute/v2.1/os-snapshots/4a27da2c-91c4-48b5-a2d5-53df6bb45beb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:32:41.086166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6434e9ec-3a35-4600-a8f9-b0e4401b4658 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadca2ba60>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:41.282520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6434e9ec-3a35-4600-a8f9-b0e4401b4658 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 202 len: 0 microversion: 2.1 time: 0.205499 Sep 26 10:32:41.283092 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 10/22] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:32:41 2022] DELETE /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:32:41.295936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d1da85ac-b82c-46d4-a5b9-4d05a85d3527 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d3550>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:41.402473 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d1da85ac-b82c-46d4-a5b9-4d05a85d3527 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 200 len: 343 microversion: 2.1 time: 0.113840 Sep 26 10:32:41.405193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:41 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 343 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:42.098335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:32:42.098854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:32:42.099818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:32:42.100904 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:32:42.101507 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:32:42.137502 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:42.138001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:42.138775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:42.139226 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:42.139696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:42.140110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:42.210679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Getting quotas for project c64a07f1fc58419e8dbd23d28a43e98b. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:32:42.217894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Getting quotas for user 398f3e872ad9499fbb26cc48ca9544d8 and project c64a07f1fc58419e8dbd23d28a43e98b. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:32:42.247456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:32:42.251434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:32:42.379862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7583cf83-f3e9-4b8e-be47-eb05c9629d14 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.084418 Sep 26 10:32:42.393983 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 13/24] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 10:32:42.394367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0f367a89-9372-4aeb-89fd-2a0d3868f1cb tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:42.395155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0f367a89-9372-4aeb-89fd-2a0d3868f1cb tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:42.424047 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8a44a361-d0b1-4b01-a152-d5ad1adbc66e tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadb6fd5e0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:42.574799 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8a44a361-d0b1-4b01-a152-d5ad1adbc66e tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 200 len: 343 microversion: 2.1 time: 0.158270 Sep 26 10:32:42.575724 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 14/25] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:42 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 343 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:42.600947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0f367a89-9372-4aeb-89fd-2a0d3868f1cb tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:42.636414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0f367a89-9372-4aeb-89fd-2a0d3868f1cb tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1214 microversion: 2.1 time: 0.246058 Sep 26 10:32:42.655350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 12/26] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:42 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:32:43.598976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0f069511-d4c3-4df2-b8ad-ac8b8aad1a99 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadb6fdd30>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:43.669186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3d622de2-5472-4677-8d26-3d9e3b806c5e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:43.672376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3d622de2-5472-4677-8d26-3d9e3b806c5e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:43.706114 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0f069511-d4c3-4df2-b8ad-ac8b8aad1a99 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 200 len: 343 microversion: 2.1 time: 0.119309 Sep 26 10:32:43.706787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 15/27] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:43 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 343 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:43.853412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3d622de2-5472-4677-8d26-3d9e3b806c5e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:43.868516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3d622de2-5472-4677-8d26-3d9e3b806c5e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1214 microversion: 2.1 time: 0.204916 Sep 26 10:32:43.883777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 13/28] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:43 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1214 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:44.722052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d5c8a3c7-bfd3-411b-84ed-2f4b8edac489 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadb6fddc0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:44.825951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-d5c8a3c7-bfd3-411b-84ed-2f4b8edac489 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] HTTP exception thrown: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d5c8a3c7-bfd3-411b-84ed-2f4b8edac489 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Request method failure captured: Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b HTTP/1.1 Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX--5NKZNkI2IPYsFJvA-B1qziJDqYS_aCZbcAdu2oXPArkGccD6RFl3Pj3NJxst84W1CWlU4HAF7210rLSUjkkxSiuzxZlfx8C5HIy24qxvMz85gsn2D-cILY4-WUd5tReMyaHroL7mpl-q7WWVLi1wVJOSPiW8Y1JyLGmRF4A0E6o Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:32:44.828479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_278d2e73018e464ab63524b9e4ebd32b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 33953f2fd2f2469e8668120ea4f9bc92 Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '174d4ad7-db40-43ec-abb4-b7ba03cc564b'} Sep 26 10:32:44.829575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. (HTTP 404) (Request-ID: req-819a98bd-bf29-420c-b787-bc764f8b6e93) Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:44.830259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:44.831287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 10:32:44.832653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.833566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.836128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d5c8a3c7-bfd3-411b-84ed-2f4b8edac489 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Returning 404 to user: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:44.837185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d5c8a3c7-bfd3-411b-84ed-2f4b8edac489 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 404 len: 109 microversion: 2.1 time: 0.120215 Sep 26 10:32:44.837949 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 16/29] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:44 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:32:44.856416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf74afae-83f2-4dfe-9415-713df6bc76bd tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc002940>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:44.900625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:44.902304 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:44.948702 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:44.951006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:44.954137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:44.955607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:44.958642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:44.960731 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:44.985822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-bf74afae-83f2-4dfe-9415-713df6bc76bd tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] HTTP exception thrown: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf74afae-83f2-4dfe-9415-713df6bc76bd tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Request method failure captured: Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: DELETE /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b HTTP/1.1 Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX--5NKZNkI2IPYsFJvA-B1qziJDqYS_aCZbcAdu2oXPArkGccD6RFl3Pj3NJxst84W1CWlU4HAF7210rLSUjkkxSiuzxZlfx8C5HIy24qxvMz85gsn2D-cILY4-WUd5tReMyaHroL7mpl-q7WWVLi1wVJOSPiW8Y1JyLGmRF4A0E6o Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:32:44.988610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_278d2e73018e464ab63524b9e4ebd32b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 33953f2fd2f2469e8668120ea4f9bc92 Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '174d4ad7-db40-43ec-abb4-b7ba03cc564b'} Sep 26 10:32:44.989746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. (HTTP 404) (Request-ID: req-c71297fe-71fb-422d-ad1c-f09f9fe0e8d1) Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:44.990445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 26 10:32:44.996093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 26 10:32:44.999697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf74afae-83f2-4dfe-9415-713df6bc76bd tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Returning 404 to user: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bf74afae-83f2-4dfe-9415-713df6bc76bd tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 404 len: 109 microversion: 2.1 time: 0.138475 Sep 26 10:32:45.001313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 14/30] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:32:44 2022] DELETE /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:32:45.015136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d8eca375-c1df-4519-94f4-641a3d6bc1a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Calling method '.version_select at 0x7fbadc0d3af0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:45.222392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-d8eca375-c1df-4519-94f4-641a3d6bc1a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] HTTP exception thrown: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d8eca375-c1df-4519-94f4-641a3d6bc1a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Request method failure captured: Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b HTTP/1.1 Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX--5NKZNkI2IPYsFJvA-B1qziJDqYS_aCZbcAdu2oXPArkGccD6RFl3Pj3NJxst84W1CWlU4HAF7210rLSUjkkxSiuzxZlfx8C5HIy24qxvMz85gsn2D-cILY4-WUd5tReMyaHroL7mpl-q7WWVLi1wVJOSPiW8Y1JyLGmRF4A0E6o Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:32:45.228184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_278d2e73018e464ab63524b9e4ebd32b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/278d2e73018e464ab63524b9e4ebd32b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 278d2e73018e464ab63524b9e4ebd32b Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2094734499 Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 33953f2fd2f2469e8668120ea4f9bc92 Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2094734499-project Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '174d4ad7-db40-43ec-abb4-b7ba03cc564b'} Sep 26 10:32:45.229274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. (HTTP 404) (Request-ID: req-264d3e76-967f-42fd-aa6c-d9a9e1dde069) Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:45.229890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:32:45.230897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 10:32:45.231889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d8eca375-c1df-4519-94f4-641a3d6bc1a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] Returning 404 to user: Volume 174d4ad7-db40-43ec-abb4-b7ba03cc564b could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d8eca375-c1df-4519-94f4-641a3d6bc1a8 tempest-VolumesSnapshotsTestJSON-2094734499 tempest-VolumesSnapshotsTestJSON-2094734499-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b" status: 404 len: 109 microversion: 2.1 time: 0.230751 Sep 26 10:32:45.233842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 15/31] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:32:44 2022] GET /compute/v2.1/os-volumes/174d4ad7-db40-43ec-abb4-b7ba03cc564b => generated 109 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:32:45.921086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:45.966734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-481038df-214c-41b3-9be7-db800f51663c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1210 microversion: 2.1 time: 1.069036 Sep 26 10:32:45.970904 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 17/32] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:44 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1210 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:32:46.998798 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:46.999595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:47.027629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:47.030609 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:47.031641 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:47.036471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:47.036873 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:47.037419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:47.553334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:47.580110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-73ade213-bf1b-4ee1-862b-ab402a3d01be tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1274 microversion: 2.1 time: 0.584931 Sep 26 10:32:47.594770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 16/33] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:46 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1274 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:48.608995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:48.610494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:48.625564 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:48.626694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:48.627200 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:48.639248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:48.641391 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:48.641995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:48.781893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ed33b47d-ecdf-4512-a998-03d5432f52e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: .version_select at 0x7fbadb691d30>, body: {"keypair": {"name": "tempest-keypair-519479374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOakFBskl6Jh6stoCLtmmFvmiNA7I2EmElvwGdeFCPv3mQl1Of9EjnBed/sdkASIsn2CBDtL4km/sqZOvwl6/1DNlrht2D9vEuGZvoXusKwqJscc1IAyGVgfaFRrU9G93w=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:48.835744 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:48.844825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5516f254-84eb-43e6-8a7e-ff1d88630341 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1274 microversion: 2.1 time: 0.242750 Sep 26 10:32:48.845711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 17/34] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:48 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:48.903773 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-ed33b47d-ecdf-4512-a998-03d5432f52e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for project 3c219db8370d4ef49f235020868144d7. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:32:48.921102 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-ed33b47d-ecdf-4512-a998-03d5432f52e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for user cdcfab461e534465a906c0eef201e423 and project 3c219db8370d4ef49f235020868144d7. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:32:49.038422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ed33b47d-ecdf-4512-a998-03d5432f52e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.442497 Sep 26 10:32:49.054471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 18/35] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:32:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:49.481192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-452117267", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:49.846563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] validate_networks() for [('0c42b441-b7cf-4fd0-9783-6f8c9cc37e1c', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:32:49.870439 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:49.871338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:49.900474 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:49.906500 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:49.911585 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:49.913825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:49.915013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:49.919651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:50.594599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:50.611928 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cab0f60a-f22a-48fc-a651-be4b9520a4b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1272 microversion: 2.1 time: 0.746016 Sep 26 10:32:50.615366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 19/36] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:49 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1272 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:51.649820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:51.651401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:51.664398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:51.665697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:51.668899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:51.678921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:51.679355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:51.680595 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:51.956110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:51.974095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-655df6db-4c4d-4b1b-9c18-990d55553156 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1272 microversion: 2.1 time: 0.340282 Sep 26 10:32:51.991795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 20/37] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:51 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:52.198092 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:32:52.371392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:32:52.371962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:32:52.372251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:32:52.372896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:32:52.373644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:32:52.459675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:52.461280 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:52.462110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:52.463084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:52.463744 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:52.464322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:52.615064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for project 615e5825389c4f1d96e6398bf1dab735. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:32:52.634235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-85d6216a-c9b0-4ba1-85eb-58bf5c45eb29 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: .version_select at 0x7fbadb610a60>, body: {"keypair": {"name": "tempest-keypair-2112293931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpOojhFk1Fc5bgm2g6ixLIUmcBOMu5YahvU/Fc5ykiNSXUJ3zkXD3sOmFc9EycSkFLZouv9g9HvLNptH+dRc88zA0bA3nsKPjSCL3Bab3Epsiu8q8qUKDeeDoLqPgycCQ=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:52.651115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for user 5085a918c6b74488b3dd70c1fb257381 and project 615e5825389c4f1d96e6398bf1dab735. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:32:52.679091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-85d6216a-c9b0-4ba1-85eb-58bf5c45eb29 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:32:52.688415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-85d6216a-c9b0-4ba1-85eb-58bf5c45eb29 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:32:52.690318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:32:52.697098 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:32:52.767708 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-85d6216a-c9b0-4ba1-85eb-58bf5c45eb29 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.774138 Sep 26 10:32:52.777924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 21/38] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:32:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:32:52.882732 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-23bd74cf-543b-4f07-9482-d5a4957de077 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.750840 Sep 26 10:32:52.885258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 18/39] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:32:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:32:52.897598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3a3832c3-9d7e-4cf1-b94f-59a4e7a05e01 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:52.898391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3a3832c3-9d7e-4cf1-b94f-59a4e7a05e01 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:53.000450 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:53.002658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:53.028262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:53.030610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:53.031204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:53.032068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:53.034746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:53.042662 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:53.443172 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3a3832c3-9d7e-4cf1-b94f-59a4e7a05e01 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:53.464497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3a3832c3-9d7e-4cf1-b94f-59a4e7a05e01 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1221 microversion: 2.1 time: 0.566569 Sep 26 10:32:53.465665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 22/40] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:52 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1221 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:53.706573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1109134638", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:53.897589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] validate_networks() for [('0c42b441-b7cf-4fd0-9783-6f8c9cc37e1c', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:32:54.530832 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:54.542988 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ca0b8703-dc50-4dc8-9103-50b4f1d8bcf2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 1.547061 Sep 26 10:32:54.551948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 19/41] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:52 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:55.574985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:55.575614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:55.630443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:55.631186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:55.637067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:55.640592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:55.641124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:55.642819 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:56.538140 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:56.565045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-695a5551-7366-4d8a-9c9c-a99871b1f65e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.993394 Sep 26 10:32:56.565963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 20/42] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:55 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:32:57.320887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1470937047", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f0c1cf-9082-4631-962e-123de80a2bb4"}], "security_groups": [{"name": "tempest-securitygroup--1486717437"}], "key_name": "tempest-keypair-519479374", "user_data": "}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:32:57.448195 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:32:57.449292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:32:57.450000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:32:57.450672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:32:57.451315 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:32:57.480411 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:57.485675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:57.508799 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:57.512811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:57.516270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:57.527806 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:57.611721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for project 615e5825389c4f1d96e6398bf1dab735. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:32:57.622894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for user 5085a918c6b74488b3dd70c1fb257381 and project 615e5825389c4f1d96e6398bf1dab735. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:32:57.671326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:32:57.686784 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:32:57.878539 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] validate_networks() for [('f9f0c1cf-9082-4631-962e-123de80a2bb4', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:32:57.903604 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e16374cf-1681-4ee0-aac1-011074977dd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.202415 Sep 26 10:32:57.917218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 23/43] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:32:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 4217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 10:32:57.945334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:57.946409 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:57.956534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:57.956988 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:57.957431 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:57.966258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:32:57.967322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:32:57.973607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:32:59.068974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:59.086477 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8539653a-690b-48e7-bf78-59a8ef78c470 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 1.160326 Sep 26 10:32:59.098422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 24/44] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:57 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:32:59.117037 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c6a01a5d-0a77-4908-9c80-8e263a8dbbfc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:32:59.118410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c6a01a5d-0a77-4908-9c80-8e263a8dbbfc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:32:59.859172 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c6a01a5d-0a77-4908-9c80-8e263a8dbbfc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:32:59.885659 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c6a01a5d-0a77-4908-9c80-8e263a8dbbfc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1222 microversion: 2.1 time: 0.774085 Sep 26 10:32:59.887116 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 25/45] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:32:59 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1222 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:00.117236 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:00.117856 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:00.136245 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:00.136855 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:00.147982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:00.163494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:00.164469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:00.164774 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:01.310768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:01.319867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4f874140-4751-42fc-a0e9-9d961712c832 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 1.206956 Sep 26 10:33:01.328246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 26/46] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:00 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:01.333111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:01.333730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:01.335687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:01.379791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:01.380306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:01.380746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:01.391096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:01.391592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:01.392040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:01.611336 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:01.626969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f7359a0a-12cc-43e7-a888-c7e18c43eab3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1274 microversion: 2.1 time: 0.297532 Sep 26 10:33:01.627845 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 27/47] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:01 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1274 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:01.632909 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1266023546", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bfae35e-29c7-4379-ac17-c54030a00cba"}], "security_groups": [{"name": "tempest-securitygroup--191527834"}], "key_name": "tempest-keypair-2112293931", "user_data": "}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:01.949882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:33:01.950427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:33:01.951169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:33:01.951782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:33:01.952285 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:33:01.985037 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:01.985645 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:01.986238 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:01.988766 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:01.991114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:01.998529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:02.098673 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for project 3c219db8370d4ef49f235020868144d7. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:33:02.104771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for user cdcfab461e534465a906c0eef201e423 and project 3c219db8370d4ef49f235020868144d7. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:33:02.124174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:33:02.127916 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:33:02.240905 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-81ed6404-69ca-47df-8823-eb5b03d35060 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.924169 Sep 26 10:33:02.248281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 21/48] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:32:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 4926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:33:02.253568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-98bb79d0-ed5b-45cb-8aec-b3f6798ef3d2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:02.259276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-98bb79d0-ed5b-45cb-8aec-b3f6798ef3d2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:02.306305 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] validate_networks() for [('5bfae35e-29c7-4379-ac17-c54030a00cba', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:33:02.594196 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-98bb79d0-ed5b-45cb-8aec-b3f6798ef3d2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:02.608913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-98bb79d0-ed5b-45cb-8aec-b3f6798ef3d2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1237 microversion: 2.1 time: 0.359208 Sep 26 10:33:02.613530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 22/49] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:02 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1237 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:02.638576 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:02.643996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:02.652612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:02.657407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:02.658496 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:02.660977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:02.664852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:02.665980 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:03.611912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:03.627512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-df686d79-65fd-432f-a241-a10bd4173f7d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 1.012596 Sep 26 10:33:03.628116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 23/50] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:02 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:03.636921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:03.637548 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:03.712076 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:03.713046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:03.715002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:03.716586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:03.719453 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:03.723385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.006745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:04.038570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-23503dc4-73ff-4341-9480-64c002319c9a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1280 microversion: 2.1 time: 0.407186 Sep 26 10:33:04.039179 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 24/51] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:03 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1280 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:04.051854 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:04.058243 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:04.077871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.078779 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.079977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.082226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.084769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.085734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.224477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:04.237950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f19a3847-4a22-451b-8699-f24dc44b7bf0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1289 microversion: 2.1 time: 0.194264 Sep 26 10:33:04.238682 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:04 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1289 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:04.754270 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4369a14-7525-4b86-8326-047357bac1f6", "tag": "1cf8afa5-f1f4-450a-b7df-1e8c12b24cb9"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:04.782826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.783448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.783909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.827404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Creating event network-changed:1cf8afa5-f1f4-450a-b7df-1e8c12b24cb9 for instance f4369a14-7525-4b86-8326-047357bac1f6 on hv-cinder-84456 Sep 26 10:33:04.827957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127055) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 10:33:04.828379 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-ffff5e0e-5b5a-46b6-b107-bec31a29c63b req-cddba2e2-2741-47d7-bd5f-c902ee70d38d service nova] Acquired lock "compute-rpcapi-router" {{(pid=127055) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 10:33:04.829472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.830089 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.832289 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.833053 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.833535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.833969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.864074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.compute.rpcapi [None req-de93895e-8207-4e42-b224-269a787877bb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 10:33:04.869959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de93895e-8207-4e42-b224-269a787877bb None None] Releasing lock "compute-rpcapi-router" {{(pid=127055) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 10:33:04.903522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-de93895e-8207-4e42-b224-269a787877bb None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.651627 Sep 26 10:33:04.904695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 26/53] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:04.923295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:04.924883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:04.935475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.936282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.936913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:04.937892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:04.938667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:04.939323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:05.008549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:33:05.009902 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:33:05.011213 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:33:05.011827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:33:05.012603 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:33:05.036456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:05.039575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:05.042484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:05.044811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:05.050524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:05.051617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:05.126965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:33:05.139094 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:33:05.163556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:33:05.166208 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:33:05.349662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c952bb67-3db8-4c1c-a47e-25f225317a97 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.720682 Sep 26 10:33:05.353129 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 28/54] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:33:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 3725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:33:05.376947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:05.390282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:05.421330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:05.423522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:05.425688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:05.431751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:05.433975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:05.437203 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:06.065764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:06.092971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2e01e46d-76ea-4439-8d45-a7fd0199184f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 1.185822 Sep 26 10:33:06.102505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 27/55] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:04 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:06.140167 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:06.146257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:06.173164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:06.174922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:06.178187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:06.179242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:06.181196 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:06.184207 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:06.460418 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:06.473838 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9fa8e753-eb40-4ec8-b72f-eb840079ed09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1280 microversion: 2.1 time: 1.117656 Sep 26 10:33:06.476489 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 29/56] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:05 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1280 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:06.498407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:06.501490 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:06.528070 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:06.528878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:06.531697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:06.535903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:06.538015 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:06.549989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:06.715313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:06.731575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-43d1d302-bb6b-498a-94c4-af5684e12617 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1295 microversion: 2.1 time: 0.611660 Sep 26 10:33:06.732253 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 28/57] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:06 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1295 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:06.913045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:06.926871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-80bc1502-5f00-41af-872f-21d1f0c11dca tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1246 microversion: 2.1 time: 0.445497 Sep 26 10:33:06.944922 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 30/58] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:06 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1246 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:07.131521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:07.132464 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:07.151589 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:07.157981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:07.158921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:07.160885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:07.165252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:07.169731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:07.508252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:07.515281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:07.535480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:07.535978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:07.536417 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:07.537123 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:07.537579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:07.538001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:07.819573 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:07.842790 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-dfdc0f6c-8e41-4f59-94e7-5d73cb4e813f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.714139 Sep 26 10:33:07.845222 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 29/59] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:07 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:07.905281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:07.907682 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:07.923993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:07.927053 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:07.928339 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:07.933253 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:07.934469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:07.936860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.451914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:08.461932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-647948f1-51ad-43e0-ae4e-cad7c601c94d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1295 microversion: 2.1 time: 0.615222 Sep 26 10:33:08.467803 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 30/60] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:07 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1295 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:08.472816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:08.482727 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:08.513137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.513975 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.514622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.515530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.516165 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.516769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.687603 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:08.700008 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:08.714496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-01affdc9-5503-4a16-953a-79d310c2547d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 1.209808 Sep 26 10:33:08.716239 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d4898db8-3123-4dde-9b7e-ebcbcfbbfbd7 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.247072 Sep 26 10:33:08.716941 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 31/61] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:07 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:08.728242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 31/62] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:08 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:08.742433 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c8ccb32-956e-4b12-b59b-4763a8ac14e9", "tag": "fb6f3a5e-f0d4-40e3-8d82-9ef01f3482ea"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:08.764841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.765445 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.765857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.788905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Creating event network-changed:fb6f3a5e-f0d4-40e3-8d82-9ef01f3482ea for instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 on hv-cinder-84456 Sep 26 10:33:08.789446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127056) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 26 10:33:08.789839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e67b1bbc-3ff5-40cd-984e-524e9b2715eb req-66b45dd4-f9c7-43b4-9477-bd815a46127a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127056) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 26 10:33:08.795326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.796131 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.796998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.799492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.802511 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.803112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.817897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.compute.rpcapi [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 26 10:33:08.818813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=127056) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 26 10:33:08.844430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9a6d6a7e-0660-4551-be4d-100a669f56a1 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117016 Sep 26 10:33:08.845531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 32/63] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:08.875004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:08.875831 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:08.883993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.884646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.885292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:08.886340 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:08.887124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:08.887612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.227292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:09.235299 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d7d4091f-c86c-4777-b2dd-402abfd58df8 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.366846 Sep 26 10:33:09.236161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:08 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:09.499387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:09.502072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:09.517901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:09.518432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:09.518872 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.519636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:09.520090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:09.520517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.675796 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:09.683980 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f36bf6f3-0baf-4b72-8afd-94f2bda98a0f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1295 microversion: 2.1 time: 0.194836 Sep 26 10:33:09.684901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 33/65] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:09 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1295 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:09.743665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:09.745095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:09.752292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:09.752924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:09.753521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:09.753740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:09.754288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.755198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:09.755998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:09.756620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.762490 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:09.765721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:09.766544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.767526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:09.768199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:09.768835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:09.934572 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:09.946240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d58f15ed-7d73-4f2f-80c3-cd33788c1549 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.195673 Sep 26 10:33:09.947057 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 34/66] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:09 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:10.258276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:10.258888 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:10.266140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:10.267011 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:10.267457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:10.268157 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:10.268803 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:10.269339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:10.346753 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:10.362311 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1c976f0d-f8eb-4779-9431-087d822cdbc2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.622760 Sep 26 10:33:10.363293 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 33/67] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:09 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:10.708349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:10.709297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:10.718537 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:10.719238 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:10.721326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:10.723349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:10.723744 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:10.726465 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:10.727066 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:10.742871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-84048d3b-2ae4-4a20-93d3-1fcd1dd5d595 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.488514 Sep 26 10:33:10.743816 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 35/68] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:10 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:10.970137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:10.970769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:10.986764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:10.987271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:10.988005 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:10.989212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:10.989672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:10.990189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:11.156918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:11.167334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-91f19019-c5cf-4b5b-bb92-29fe6953a30f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.202414 Sep 26 10:33:11.178154 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 36/69] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:10 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:11.194567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:11.197287 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=97 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:11.207675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-09c616a1-994e-4b42-ada1-68134660374e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.503643 Sep 26 10:33:11.208710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 34/70] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:10 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:11.385495 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:11.386525 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:11.394427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:11.394995 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:11.395507 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:11.396293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:11.396829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:11.397319 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:11.401684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=89 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:11.557548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:11.569399 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6d023f6a-c910-451d-852a-8ca61382c086 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.188354 Sep 26 10:33:11.570590 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 37/71] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:11 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:11.621667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-e5401674-4463-4540-aeff-86973d72078b req-2c6e2059-f3ae-4ef1-9412-586042911162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85ae4608-c737-41ca-83a0-2fab0aebd65f", "tag": "696dd099-9ca9-4a5d-a056-1b76c99ea49e"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:11.626712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:11.633113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e5401674-4463-4540-aeff-86973d72078b req-2c6e2059-f3ae-4ef1-9412-586042911162 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:11.635655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e5401674-4463-4540-aeff-86973d72078b req-2c6e2059-f3ae-4ef1-9412-586042911162 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:11.636101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e5401674-4463-4540-aeff-86973d72078b req-2c6e2059-f3ae-4ef1-9412-586042911162 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:11.651919 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-e5401674-4463-4540-aeff-86973d72078b req-2c6e2059-f3ae-4ef1-9412-586042911162 service nova] Creating event network-changed:696dd099-9ca9-4a5d-a056-1b76c99ea49e for instance 85ae4608-c737-41ca-83a0-2fab0aebd65f on hv-cinder-84456 Sep 26 10:33:11.656906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-e5401674-4463-4540-aeff-86973d72078b req-2c6e2059-f3ae-4ef1-9412-586042911162 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205878 Sep 26 10:33:11.657811 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 35/72] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:33:11.770772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:11.771386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:11.777805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:11.778319 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:11.778753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:11.779481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:11.779884 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:11.780308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:11.922751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:11.930435 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-bb3e7829-5f2f-4548-897c-9ffc493047c2 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.163395 Sep 26 10:33:11.931088 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 38/73] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:11 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:12.191653 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:12.192445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:12.201093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.201722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.202042 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.202750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.203209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.203637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.231585 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:12.233098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:12.242092 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.242861 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.243545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.256567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.257066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.257511 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.288613 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:12.296549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e45b556e-f173-4e32-b805-842ae240f851 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.109231 Sep 26 10:33:12.297337 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 36/74] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:12 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:12.428223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:12.436429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d09b9b4b-48af-40fa-907b-bb12917fef92 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.209065 Sep 26 10:33:12.437175 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 39/75] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:12 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:12.605051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:12.605678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:12.609540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=18 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:12.613850 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.614360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.614980 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.615672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.616459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.617114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.787902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:12.801455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4274a454-f93b-4b80-8890-f440087fc8ff tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.210977 Sep 26 10:33:12.802016 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 37/76] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:12 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:12.952420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:12.953106 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:12.959019 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.959504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.959947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:12.960730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:12.961067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:12.961535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.094296 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:13.102289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fe752b3b-2cad-419c-afcf-cae98ff3ef81 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.153581 Sep 26 10:33:13.102866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 40/77] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:12 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:13.320206 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:13.320781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:13.326842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:13.327403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:13.327974 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.328810 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:13.329265 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:13.329690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.390568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:13.398426 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ce292155-406d-4285-8a4b-a31a22629c79 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.082155 Sep 26 10:33:13.398995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 38/78] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:13 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:13.459885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:13.460521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:13.467001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:13.467476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:13.467939 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.468617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:13.469090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:13.469509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.599835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:13.607335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-26b739cb-05af-4aba-bcf2-435b9eb82a4a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.151306 Sep 26 10:33:13.607891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 41/79] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:13 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:13.827302 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:13.827969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:13.833762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:13.834283 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:13.834721 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.835409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:13.835866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:13.836289 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:13.968648 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:13.976404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2480c735-9de7-46d1-a250-fb899951c3c6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.153787 Sep 26 10:33:13.976970 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 39/80] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:13 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:14.128375 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:14.128905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:14.134780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:14.135904 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:14.136337 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:14.137014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:14.137465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:14.137903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:14.265567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:14.273122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-14ff13fd-fb43-4b46-9c74-c75991f22525 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.148693 Sep 26 10:33:14.273683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 42/81] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:14 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:14.422081 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:14.422635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:14.428475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:14.428951 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:14.429375 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:14.430076 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:14.430523 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:14.430938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:14.490493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:14.499473 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3dfd5b31-3d44-42da-8a59-9004e820190c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.081346 Sep 26 10:33:14.500052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 40/82] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:14 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:14.629921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:14.630563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:14.636528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:14.637007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:14.637443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:14.638153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:14.638610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:14.639035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:14.765467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:14.772957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6060b809-d42b-458d-b82e-a5a0a458c4c6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.146878 Sep 26 10:33:14.773524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 43/83] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:14 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:14.999353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:14.999962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:15.001828 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:15.007160 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.007638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.008070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.008750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.009196 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.009613 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.146542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:15.156143 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-58f01fd7-381f-4037-9109-62c5c9fd5d1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.160425 Sep 26 10:33:15.156770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 41/84] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:14 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:15.300051 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:15.300675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:15.305121 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=30 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:15.319205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.319710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.320611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.320855 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.321311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.321736 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.499794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:15.515520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-649af8da-e2ec-41b0-b041-abe7a82c7f56 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.223782 Sep 26 10:33:15.518380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 44/85] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:15 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:15.525885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:15.528176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:15.539773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.540585 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.541068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.541835 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.542406 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.543026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.613217 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:15.623890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-750fecda-b45c-49d1-a047-c0f81c1865d4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.105295 Sep 26 10:33:15.624998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 42/86] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:15 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:15.796952 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:15.797684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:15.803956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.804447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.804881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.805577 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:15.806554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:15.807307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:15.971599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:15.982109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7bf68403-c790-455f-ac8a-59381d0078f2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.190645 Sep 26 10:33:15.983021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 45/87] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:15 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:16.180619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:16.181325 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:16.187565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:16.188133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:16.188578 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:16.189274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:16.189730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:16.190223 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:16.331163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:16.339632 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1bdd1669-84fa-432e-b0a5-30b584ef66b8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.162791 Sep 26 10:33:16.350467 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 43/88] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:16 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:16.540409 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:16.541035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:16.547186 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:16.547677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:16.548119 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:16.548814 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:16.549271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:16.549697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:16.647430 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:16.648040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:16.658067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:16.658569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:16.659010 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:16.659728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:16.660181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:16.660757 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:16.744474 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:16.751988 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:16.761197 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b5587581-d47d-4303-8bcc-fd1a3bdc6568 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.117086 Sep 26 10:33:16.766064 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-88dcaa44-c488-44c6-a2a7-cea12d7452de tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.229548 Sep 26 10:33:16.766648 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 44/89] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:16 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:16.767636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 46/90] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:16 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:17.010059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:17.010454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:17.017139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.017616 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.018067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.018757 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.019205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.019620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.155257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:17.162858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d8a20eab-13df-4f6b-9126-a5139275887c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.159137 Sep 26 10:33:17.163427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 45/91] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:17 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:17.364149 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:17.365615 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:17.373225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.373738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.374181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.374875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.375324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.375745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.514061 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:17.523182 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7b683c64-0a38-4308-8d84-ed9049da7e49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.163363 Sep 26 10:33:17.523763 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 47/92] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:17 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:17.788761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:17.789630 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:17.791254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:17.792698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:17.796894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.797472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.798067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.798779 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.799307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.805049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.805184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.805184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.805184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.805184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:17.805462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:17.805462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:17.872695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:17.881325 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1596e3cc-5e5b-4360-bd8d-49442900d36c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.096126 Sep 26 10:33:17.882070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 46/93] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:17 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:17.969349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:17.978219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4d574b09-0cf7-4ab2-a63a-58ef1f67ef6d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.191573 Sep 26 10:33:17.978810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 48/94] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:17 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:18.187166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:18.187788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:18.193983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:18.194495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:18.194927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:18.195655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:18.196112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:18.196533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:18.336975 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:18.347765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-914922ef-6f31-4629-b51e-7946ff5a30b2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.165396 Sep 26 10:33:18.348865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 47/95] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:18 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:18.551141 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:18.551934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:18.563982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:18.564667 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:18.565445 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:18.566295 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:18.566897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:18.567386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:18.815636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=6 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:18.905560 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:18.906266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:18.912315 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:18.912814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:18.913257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:18.913959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:18.914444 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:18.914870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:19.068957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:19.080022 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-aac7c048-9dec-4eeb-9cda-9a87d0b4ecf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1300 microversion: 2.1 time: 0.178979 Sep 26 10:33:19.080989 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 48/96] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:18 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:19.097025 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:19.097638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:19.106998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:19.107489 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:19.107923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:19.108985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:19.109481 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:19.109909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:19.241946 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:19.251380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c7b06878-9fc8-4aa5-bc55-67e01793a810 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.707362 Sep 26 10:33:19.252066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 49/97] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:18 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:19.371936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:19.372541 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:19.378747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:19.379225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:19.379660 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:19.380343 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:19.380804 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:19.381205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:19.460678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:19.468358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1bca0678-4665-4155-b712-084dd9611690 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.377070 Sep 26 10:33:19.469118 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 49/98] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:19 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:19.697720 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:19.706099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-779efdda-65a7-4157-a357-09da2822fb34 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.338621 Sep 26 10:33:19.706677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:19 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:20.103962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:20.104381 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:20.113522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.114263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.114773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.115846 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.116478 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.117103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.274074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-9e4d7601-f822-4705-979a-c178a65b2c60 req-015a71f5-6834-4a63-8009-006cb1eef3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ca6fe02-8975-4daa-a713-5ec2520b2d67", "tag": "798a1629-515e-41fd-8c26-34ded4b3db4d"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:20.291484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-9e4d7601-f822-4705-979a-c178a65b2c60 req-015a71f5-6834-4a63-8009-006cb1eef3e4 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.294719 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-9e4d7601-f822-4705-979a-c178a65b2c60 req-015a71f5-6834-4a63-8009-006cb1eef3e4 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.295228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-9e4d7601-f822-4705-979a-c178a65b2c60 req-015a71f5-6834-4a63-8009-006cb1eef3e4 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.307753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-9e4d7601-f822-4705-979a-c178a65b2c60 req-015a71f5-6834-4a63-8009-006cb1eef3e4 service nova] Creating event network-changed:798a1629-515e-41fd-8c26-34ded4b3db4d for instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 on hv-cinder-84456 Sep 26 10:33:20.313144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-9e4d7601-f822-4705-979a-c178a65b2c60 req-015a71f5-6834-4a63-8009-006cb1eef3e4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044410 Sep 26 10:33:20.313750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 51/100] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:33:20.321691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:20.324333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:20.331240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.331966 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.332548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.333425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.333905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.334348 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.365372 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:20.374250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-18d0c475-caa4-4ba9-9eec-da076126846c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.274369 Sep 26 10:33:20.374836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 50/101] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:20 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:20.471364 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:20.479163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4cfb25b1-e709-46d0-a2b8-2d6a9264dcac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.164308 Sep 26 10:33:20.479726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 52/102] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:20 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:20.491123 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:20.491736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:20.497691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.498232 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.498642 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.499327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.499779 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.500207 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.624156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:20.631711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fc15cac0-587c-40a0-ae38-610dc4209e6b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.144385 Sep 26 10:33:20.632276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 51/103] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:20 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:20.729225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:20.729767 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:20.735617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.736097 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.736535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.737217 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:20.737677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:20.738125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:20.869084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:20.877091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b733bbd0-8b57-4d7b-8e43-7225221c188d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.151775 Sep 26 10:33:20.877644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 53/104] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:20 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:21.397708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:21.398340 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:21.405074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:21.405872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:21.406530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:21.408529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:21.409530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:21.410156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:21.414381 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=100 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:21.502115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:21.503051 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:21.510137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:21.510942 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:21.511380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:21.512087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:21.512603 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:21.513041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:21.529964 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:22.219490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:22.227559 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8cae52ef-8f25-4e71-9133-9cf8470c01a9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.833565 Sep 26 10:33:22.228124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 52/105] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:21 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:22.232769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:22.233376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:22.239095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:22.239582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:22.240022 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:22.240705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:22.241158 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:22.241579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:22.304868 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:22.313885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6d2798ee-b941-4a3a-a384-298d8b782504 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.815847 Sep 26 10:33:22.314496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 54/106] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:21 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:22.318897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:22.320111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:22.326725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:22.327208 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:22.327642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:22.328334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:22.328874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:22.329295 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:22.651329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:22.667377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:22.684289 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-16aa7ccf-c57d-4bf1-97e9-72bb9b589ea0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.455079 Sep 26 10:33:22.687418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 53/107] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:22 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:22.688143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b8a9e2e0-a1c8-4425-a8dd-6e153999e4b3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.370570 Sep 26 10:33:22.688857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 55/108] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:22 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:23.068910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-2aa3f200-05fd-4e39-9167-a8067d1a1cce req-cf5b51a1-b9d9-4b67-8da4-1b9017838ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcde70f-d1b6-40ce-8bcd-d17b1986f320", "tag": "75ba1d3d-2195-4f53-bc3d-9641a06aa644"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:23.079194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-2aa3f200-05fd-4e39-9167-a8067d1a1cce req-cf5b51a1-b9d9-4b67-8da4-1b9017838ecf service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.079781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-2aa3f200-05fd-4e39-9167-a8067d1a1cce req-cf5b51a1-b9d9-4b67-8da4-1b9017838ecf service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.080310 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-2aa3f200-05fd-4e39-9167-a8067d1a1cce req-cf5b51a1-b9d9-4b67-8da4-1b9017838ecf service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.091900 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-2aa3f200-05fd-4e39-9167-a8067d1a1cce req-cf5b51a1-b9d9-4b67-8da4-1b9017838ecf service nova] Creating event network-changed:75ba1d3d-2195-4f53-bc3d-9641a06aa644 for instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 on hv-cinder-84456 Sep 26 10:33:23.096910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-2aa3f200-05fd-4e39-9167-a8067d1a1cce req-cf5b51a1-b9d9-4b67-8da4-1b9017838ecf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031704 Sep 26 10:33:23.097886 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 54/109] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:23.251515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:23.252166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:23.257920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.258436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.258876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.259568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.260035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.260461 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.341316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:23.342132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:23.348772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.349331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.349826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.350608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.351264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.351766 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.462061 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:23.471205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3c7591c1-6f21-4bf9-a002-c1ddb76888c4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.223619 Sep 26 10:33:23.472192 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 56/110] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:23 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:23.520088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:23.528575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-92be3876-8964-4c4b-b2cc-60deeee50730 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.192299 Sep 26 10:33:23.529161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 55/111] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:23 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:23.715387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:23.715387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:23.721684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:23.722212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.722537 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:23.722749 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.723193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.724159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.724617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.725052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.730765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.731334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.731981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.732757 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:23.733285 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:23.733786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:23.927768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:23.936568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-90d48d04-b548-4e32-84f7-30e9e0149088 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.226159 Sep 26 10:33:23.937155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 57/112] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:23 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:23.951982 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:23.959989 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-be361f39-158f-4c6c-a4fb-02fbb83363ae tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.242551 Sep 26 10:33:23.960564 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 56/113] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:23 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:24.494449 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:24.495356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:24.502463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.503121 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.503613 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.504298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.504748 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.505166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.551369 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:24.551981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:24.557992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.558500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.558935 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.559619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.560064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.560477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.683865 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:24.691712 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3a4e1c02-d288-432e-9982-51d37d019db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.200972 Sep 26 10:33:24.692301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 58/114] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:24 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:24.726940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:24.735023 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d9154272-3888-45e2-9ea8-b7c957745c49 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.187461 Sep 26 10:33:24.735585 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 57/115] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:24 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:24.959512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:24.960127 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:24.966785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.967269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.967709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.968390 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.968846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.969276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.985040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:24.985966 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:24.992954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.993433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.993866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:24.994581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:24.995031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:24.995449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:25.316358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:25.323037 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:25.324856 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4698f944-9371-471a-aa05-bae72079154b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.369128 Sep 26 10:33:25.325438 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 59/116] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:24 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:25.331504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-74e47f0d-7d89-47a2-b66c-18a36bc65be8 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.351684 Sep 26 10:33:25.332066 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 58/117] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:24 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:25.714880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:25.715413 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:25.721370 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:25.721854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:25.722328 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:25.723014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:25.723734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:25.724163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:25.757670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:25.758293 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:25.764934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:25.765408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:25.765833 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:25.766544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:25.766986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:25.767399 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:25.904743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:25.912531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-afd99460-6c3e-4126-b114-dfa4cffe22d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.202196 Sep 26 10:33:25.913111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 60/118] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:25 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:25.937857 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:25.945605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8296d317-c88c-4721-83a0-50f940799c66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.191708 Sep 26 10:33:25.946188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 59/119] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:25 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:26.355878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:26.357367 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:26.359694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:26.360955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:26.394619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:26.398324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:26.399247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:26.399747 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:26.400568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:26.402671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:26.403569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:26.404518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:26.406074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:26.406799 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:26.406972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:26.407880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:27.006996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:27.009333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:27.016691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-28ffd90d-0ed3-48c0-89e1-e67902279180 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.671245 Sep 26 10:33:27.017725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 61/120] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:26 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:27.022601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b3a22a94-13c9-4eeb-b93d-12706a8bcfcd tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.670948 Sep 26 10:33:27.034044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 60/121] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:26 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:27.038145 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:27.038931 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:27.045546 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:27.046130 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:27.046568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:27.047316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:27.048038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:27.048460 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:27.166358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-374feb85-0f21-4e4a-9ca6-7e1ab62a71d4 req-0edaa73c-51fe-473d-98aa-a465ac6a43c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4369a14-7525-4b86-8326-047357bac1f6", "name": "network-vif-plugged", "status": "completed", "tag": "1cf8afa5-f1f4-450a-b7df-1e8c12b24cb9"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:27.178233 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-374feb85-0f21-4e4a-9ca6-7e1ab62a71d4 req-0edaa73c-51fe-473d-98aa-a465ac6a43c4 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:27.179482 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-374feb85-0f21-4e4a-9ca6-7e1ab62a71d4 req-0edaa73c-51fe-473d-98aa-a465ac6a43c4 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:27.180115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-374feb85-0f21-4e4a-9ca6-7e1ab62a71d4 req-0edaa73c-51fe-473d-98aa-a465ac6a43c4 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:27.200893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-374feb85-0f21-4e4a-9ca6-7e1ab62a71d4 req-0edaa73c-51fe-473d-98aa-a465ac6a43c4 service nova] Creating event network-vif-plugged:1cf8afa5-f1f4-450a-b7df-1e8c12b24cb9 for instance f4369a14-7525-4b86-8326-047357bac1f6 on hv-cinder-84456 Sep 26 10:33:27.214351 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-374feb85-0f21-4e4a-9ca6-7e1ab62a71d4 req-0edaa73c-51fe-473d-98aa-a465ac6a43c4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.194534 Sep 26 10:33:27.215651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 62/122] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:27.222522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:27.224175 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:27.231074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:27.232580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:27.233209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:27.234115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:27.234776 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:27.236147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:27.787814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:27.814189 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9304e225-5c20-4534-a3b3-b2f64e998b1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.788376 Sep 26 10:33:27.825123 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:27.830903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 61/123] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:27 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:27.836147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-83c46ad7-5fc5-4131-8823-3c830ce3196c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.618777 Sep 26 10:33:27.837526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 63/124] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:27 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:28.044333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:28.044933 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:28.047318 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:28.048534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:28.058967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.059820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.060432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.060994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.061601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.061728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.062411 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.062544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.063124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.065102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.065510 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.065946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.322670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:28.325544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:28.335044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d236cae8-a243-483a-b836-0ffb8ba63316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.291840 Sep 26 10:33:28.336112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 64/125] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:28 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:28.342882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-21a7d2b6-da70-4808-a8aa-54744983acdc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.302119 Sep 26 10:33:28.343667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 62/126] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:28 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:28.846286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:28.847144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:28.853986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.854623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.855478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.856484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.857259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.857756 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.865305 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:28.865912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:28.873129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.873619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.874136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:28.874835 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:28.875282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:28.875701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:29.076629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:29.081503 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:29.085398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-976c55c9-02f1-4457-8605-5dd72b2063c8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.246593 Sep 26 10:33:29.086702 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 65/127] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:28 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:29.108043 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cee629a6-7720-489c-bf66-7dbb213d3db1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.246429 Sep 26 10:33:29.108641 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 63/128] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:28 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:29.233488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-40e124b0-208c-49b6-a256-84bf205a31af req-b66dafc6-8024-4919-bfe5-727757a6dd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8ccb32-956e-4b12-b59b-4763a8ac14e9", "name": "network-vif-plugged", "status": "completed", "tag": "fb6f3a5e-f0d4-40e3-8d82-9ef01f3482ea"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:29.243372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-40e124b0-208c-49b6-a256-84bf205a31af req-b66dafc6-8024-4919-bfe5-727757a6dd59 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:29.243912 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-40e124b0-208c-49b6-a256-84bf205a31af req-b66dafc6-8024-4919-bfe5-727757a6dd59 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:29.244338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-40e124b0-208c-49b6-a256-84bf205a31af req-b66dafc6-8024-4919-bfe5-727757a6dd59 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:29.255744 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-40e124b0-208c-49b6-a256-84bf205a31af req-b66dafc6-8024-4919-bfe5-727757a6dd59 service nova] Creating event network-vif-plugged:fb6f3a5e-f0d4-40e3-8d82-9ef01f3482ea for instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 on hv-cinder-84456 Sep 26 10:33:29.260642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-40e124b0-208c-49b6-a256-84bf205a31af req-b66dafc6-8024-4919-bfe5-727757a6dd59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031212 Sep 26 10:33:29.261247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 66/129] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:29.359047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:29.359652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:29.365739 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:29.366433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:29.366871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:29.368030 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:29.368144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:29.368763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:29.368903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:29.369187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:29.377314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:29.377857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:29.378692 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:29.379397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:29.380175 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:29.380951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:29.578994 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:29.582217 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:29.590880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f51e1e05-5e5f-4980-8843-5f4eea8cfaf0 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.227965 Sep 26 10:33:29.591169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3ce04d89-ccc4-48c6-8b85-87791dd975ac tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.235851 Sep 26 10:33:29.598934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 67/130] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:29 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:29.602229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 64/131] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:29 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:30.109940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:30.110647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:30.116682 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.117168 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.117602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.118365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.118874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.119304 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.140860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:30.142047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:30.152665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.153153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.153590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.154313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.154764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.155186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.342532 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:30.350434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:30.360900 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-685d9690-19e1-4f3f-9285-4aec3dec015c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.223928 Sep 26 10:33:30.363937 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-14e122fc-d025-43b5-be8b-c5043a1f7c33 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.257863 Sep 26 10:33:30.364513 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 68/132] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:30 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:30.378049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 65/133] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:30 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:30.617191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:30.618163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:30.620971 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:30.621587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:30.626374 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.626647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:30.626987 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.627486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.628355 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.629016 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.629720 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.630257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.630755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.631310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.632011 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:30.632661 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:30.633289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:30.841781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:30.850874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-35550d4c-f3f4-4a4b-84b1-13e888c72d7e tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.238116 Sep 26 10:33:30.852454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:30.866405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-64e4ef41-39fe-4bdf-bd61-8fe5f77b09b1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.244186 Sep 26 10:33:30.866405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 69/134] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:30 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:30.867422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 66/135] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:30 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:31.388626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:31.389132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:31.389507 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:31.389620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:31.395378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.395502 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.395862 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.395980 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.396303 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.396399 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.396993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.397084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.397449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.397546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.397873 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.397965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.603046 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:31.606507 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:31.612347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e99594a2-aa80-475b-827b-49407cfe0fdd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.227779 Sep 26 10:33:31.613168 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 70/136] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:31 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:31.614175 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-458c90e9-e3b8-4d41-bf2e-e1cdd427f892 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.229595 Sep 26 10:33:31.614764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 67/137] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:31 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:31.875821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:31.876430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:31.882284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.882759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.883189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.883868 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.884312 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.884555 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:31.884725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.885181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:31.891041 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.891562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.892007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:31.892689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:31.893139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:31.893557 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:32.082251 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:32.091191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-06bcfe87-5789-4d61-86ff-1db78315f2b7 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.218821 Sep 26 10:33:32.091340 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:32.092821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 71/138] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:31 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:32.112714 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-479e721a-c2f3-4c97-9a06-ddbe07e12796 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.232274 Sep 26 10:33:32.113370 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 68/139] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:31 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:32.635125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:32.636383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:32.640237 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:32.640977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:32.642699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:32.643170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:32.643609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:32.644274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:32.644714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:32.645127 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:32.646838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:32.647332 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:32.647763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:32.648444 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:32.648894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:32.649335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:32.660245 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:32.666498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=100 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:32.883876 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:32.889311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:32.893741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9b1fde2f-87d6-4b28-9c84-db648d069b36 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.257701 Sep 26 10:33:32.894527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 69/140] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:32 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:32.897659 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-48d244c5-5a5e-4227-b1e5-bb282ab5ca26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.266419 Sep 26 10:33:32.898260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 72/141] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:32 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:33.116438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:33.117135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:33.126737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.127307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.127822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.128690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.129209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.129702 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.139874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:33.140654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:33.148377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.149035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.150066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.150935 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.152087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.153224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.421966 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:33.428174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:33.429785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1ddc2247-9fea-4849-a79a-e7cb59c75b3f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.317353 Sep 26 10:33:33.430716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 70/142] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:33 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:33.436428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c257f614-7539-469a-9bb8-7157a1e43efe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.301314 Sep 26 10:33:33.436996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 73/143] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:33 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:33.919327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:33.920028 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:33.924600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:33.925377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:33.926146 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.926699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.927199 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.928033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.928549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.929293 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.931813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.932303 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.933326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:33.934111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:33.934571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:33.934999 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:34.144965 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:34.147060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:34.161925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e6565540-f0ba-469e-913c-6cf8827ec40f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.245036 Sep 26 10:33:34.166071 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-87e9dd0c-0763-49c1-9c9d-753827b6e754 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.251631 Sep 26 10:33:34.166628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 71/144] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:33 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:34.174478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 74/145] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:33 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:34.453914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:34.454768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:34.459465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:34.460078 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:34.460625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:34.461109 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:34.461625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:34.462244 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:34.462690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:34.463104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:34.467212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:34.467696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:34.468132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:34.468821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:34.469273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:34.469693 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:34.659338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:34.662338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:34.667115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-692f1847-0b27-4cfe-8bfa-dee83ac76f7c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.217057 Sep 26 10:33:34.667893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 72/146] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:34 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:34.669837 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-92999968-9615-4c83-be35-5ded454c696e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.214118 Sep 26 10:33:34.670560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 75/147] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:34 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:35.197351 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:35.201586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:35.205235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:35.205996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:35.209197 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.210084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.210971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.213081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.213274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.214752 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.215462 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.216071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.217473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.219894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.220557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.222496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.418701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:35.437230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:35.441731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c7e58fd1-871a-4e46-b1c3-8bd979eaa826 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.248099 Sep 26 10:33:35.442370 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 73/148] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:35 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:35.444952 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3537f9ac-1962-4719-8e76-a2df1e8445d5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.244205 Sep 26 10:33:35.445507 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 76/149] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:35 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:35.447205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-88984fc6-2134-4c5d-a9bd-ca6bf7acd31c req-138781b8-f34e-4638-917a-22565f46f324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ae4608-c737-41ca-83a0-2fab0aebd65f", "name": "network-vif-plugged", "status": "completed", "tag": "696dd099-9ca9-4a5d-a056-1b76c99ea49e"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:35.457314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-88984fc6-2134-4c5d-a9bd-ca6bf7acd31c req-138781b8-f34e-4638-917a-22565f46f324 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.457802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-88984fc6-2134-4c5d-a9bd-ca6bf7acd31c req-138781b8-f34e-4638-917a-22565f46f324 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.458251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-88984fc6-2134-4c5d-a9bd-ca6bf7acd31c req-138781b8-f34e-4638-917a-22565f46f324 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.469968 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-88984fc6-2134-4c5d-a9bd-ca6bf7acd31c req-138781b8-f34e-4638-917a-22565f46f324 service nova] Creating event network-vif-plugged:696dd099-9ca9-4a5d-a056-1b76c99ea49e for instance 85ae4608-c737-41ca-83a0-2fab0aebd65f on hv-cinder-84456 Sep 26 10:33:35.475272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-88984fc6-2134-4c5d-a9bd-ca6bf7acd31c req-138781b8-f34e-4638-917a-22565f46f324 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031818 Sep 26 10:33:35.475847 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 74/150] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:35.690264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:35.690786 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:35.691927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:35.692612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:35.696745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.697260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.697691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.698975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.699423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.699515 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.699839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.699928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.700418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.701111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:35.701618 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:35.702083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:35.891338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:35.898741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:35.899280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8fe229b5-a723-4718-a1c9-60547d0e50fa tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.213058 Sep 26 10:33:35.901035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 77/151] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:35 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:35.906728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2629557c-6629-400d-a193-288485bf518f tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.218914 Sep 26 10:33:35.907282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 75/152] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:35 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:36.465307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:36.465881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:36.469142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:36.469761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:36.472594 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.473077 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.473996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.474771 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.475226 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.475650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.487335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.488159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.489049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.489919 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.490406 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.490827 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.866863 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:36.867589 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:36.875775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-578773c5-45d9-42bd-8f90-c12a13269697 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.414915 Sep 26 10:33:36.876007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c43d4241-4b31-4fab-8241-f5f5cb160197 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.411883 Sep 26 10:33:36.876428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 78/153] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:36 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:36.876540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 76/154] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:36 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:36.921033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:36.921636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:36.927527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.928006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.928438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.929119 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.929573 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.930040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.931039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:36.931884 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:36.939171 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.939661 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.940094 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:36.940973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:36.941424 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:36.941844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:37.144132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:37.147169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:37.153439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cb1b7567-bd77-4543-b753-b93eb88d35ba tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.235936 Sep 26 10:33:37.153954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 77/155] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:36 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:37.155866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6aa8ad22-f1a9-4991-a911-e87c5d576e63 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.230934 Sep 26 10:33:37.156573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 79/156] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:36 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:37.899096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:37.899596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:37.899983 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:37.900081 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:37.906246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:37.906385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:37.906750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:37.906871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:37.907165 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:37.907279 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:37.907849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:37.907956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:37.908297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:37.908401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:37.908720 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:37.908827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:38.103249 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:38.106668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:38.111525 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c7ee4dd1-bd43-478f-9ff3-356488e83ae9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.216237 Sep 26 10:33:38.112099 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 78/157] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:37 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:38.114844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-eaa27071-18fd-4456-b6d6-b7d798566c52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.219578 Sep 26 10:33:38.115418 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 80/158] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:37 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:38.176064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:38.176677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:38.177773 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:38.178408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:38.182649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:38.183136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:38.183567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:38.184052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:38.184255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:38.184532 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:38.184726 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:38.184964 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:38.185132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:38.185640 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:38.186109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:38.186526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:38.380154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:38.383704 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:38.388506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7bc02905-bcc3-4e2f-9b86-b06ad15b9048 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.216148 Sep 26 10:33:38.389264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 79/159] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:38 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:38.391756 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3f03ac1b-a471-4cab-a17d-4864ba5ded09 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.217560 Sep 26 10:33:38.392446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 81/160] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:38 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:39.135059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:39.136125 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:39.138545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:39.139200 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:39.142818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.143304 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.143737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.144434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.144882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.145008 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.145300 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.145456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.145888 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.146628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.147074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.147485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.333836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:39.342202 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:39.342430 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2a72eb0a-c7f2-4af9-837e-8bc69a9bd47e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.212290 Sep 26 10:33:39.343130 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 80/161] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:39 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:39.350394 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-80889bd2-469b-4f5f-b2f8-645ea9b97bd1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.215894 Sep 26 10:33:39.351110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 82/162] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:39 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:39.412026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:39.412769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:39.414465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:39.415022 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:39.419118 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.420280 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.420280 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.420848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.421286 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.421397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.421704 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.421821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.422314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.423081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:39.423540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:39.423960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:39.640538 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:39.645174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:39.648627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3805f821-19b8-4eeb-b27c-15b4fa09e69a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.237864 Sep 26 10:33:39.649205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 83/163] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:39 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:39.654754 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4c30e0af-97ac-46c1-a4a9-0a21d00654dc tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1314 microversion: 2.1 time: 0.246699 Sep 26 10:33:39.655435 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 81/164] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:39 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:40.368176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:40.369815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:40.377755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.378294 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.378727 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.379427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.379650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:40.380133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.380310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.381394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:40.388439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.388892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.389459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.390772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.391369 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.392018 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.627137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:40.630908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:40.641407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8e11e468-6a5a-41c3-8478-19e0960cf9c1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.266080 Sep 26 10:33:40.641924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 82/165] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:40 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:40.659602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a7ad67f9-abca-490a-9abf-867a1984a106 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.296669 Sep 26 10:33:40.661385 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 84/166] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:40 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:40.679669 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:40.679858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:40.680271 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:40.680715 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:40.690046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.691728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.692419 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.693244 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.694574 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.695230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.696159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.696423 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.697050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.697940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:40.699142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:40.699736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:40.936064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:40.936185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:40.943788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5f0dae17-688a-422f-adfb-e10a98a2345a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.268123 Sep 26 10:33:40.944442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3c76d545-1ff0-45b2-96f0-b9b5ea8bef19 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1501 microversion: 2.1 time: 0.268782 Sep 26 10:33:40.945031 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 85/167] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:40 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:40.958338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 83/168] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:40 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:41.666152 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:41.666772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:41.677045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:41.677741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:41.678573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:41.679833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:41.680462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:41.681392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:41.690942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:41.691547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:41.693978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=98 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:41.703387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:41.704132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:41.704772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:41.705663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:41.706352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:41.706976 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:42.021205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:42.044423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c0bcea31-7a59-4260-a42f-b31ce9bcfdeb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.377408 Sep 26 10:33:42.056008 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:42.063100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 86/169] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:41 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:42.064673 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9206721e-b627-42fe-8eba-28a7ed1a7681 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.378142 Sep 26 10:33:42.068523 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 84/170] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:41 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:42.082209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:42.082849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:42.092959 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-754e2b61-33b7-4bcd-ac64-bfdab36d281b req-81cbf432-098c-4f3d-a18a-58313a5a1b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca6fe02-8975-4daa-a713-5ec2520b2d67", "name": "network-vif-plugged", "status": "completed", "tag": "798a1629-515e-41fd-8c26-34ded4b3db4d"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:42.097355 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:42.099442 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:42.100425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:42.101882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:42.102678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:42.103322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:42.121017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-754e2b61-33b7-4bcd-ac64-bfdab36d281b req-81cbf432-098c-4f3d-a18a-58313a5a1b6c service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:42.125024 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-754e2b61-33b7-4bcd-ac64-bfdab36d281b req-81cbf432-098c-4f3d-a18a-58313a5a1b6c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:42.125481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-754e2b61-33b7-4bcd-ac64-bfdab36d281b req-81cbf432-098c-4f3d-a18a-58313a5a1b6c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:42.156743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-754e2b61-33b7-4bcd-ac64-bfdab36d281b req-81cbf432-098c-4f3d-a18a-58313a5a1b6c service nova] Creating event network-vif-plugged:798a1629-515e-41fd-8c26-34ded4b3db4d for instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 on hv-cinder-84456 Sep 26 10:33:42.166423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-754e2b61-33b7-4bcd-ac64-bfdab36d281b req-81cbf432-098c-4f3d-a18a-58313a5a1b6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099761 Sep 26 10:33:42.167054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 87/171] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:42.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ce0841b-3868-4b80-a782-30af0abe744a"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:42.438914 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:42.450888 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:42.454057 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:42.458555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:42.459487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:42.461164 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:42.463112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:42.589740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:42.603485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0a18ce26-3e7d-4c8f-8ecd-9c3502002f41 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.533855 Sep 26 10:33:42.604070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 85/172] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:42 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:43.068416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:43.069897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:43.075992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:43.076685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:43.077105 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:43.077801 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:43.078277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:43.078700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:43.324064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:43.326845 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=100 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:43.338085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cb32309d-8494-4ced-ad01-60af04a665a5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.273332 Sep 26 10:33:43.339312 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 86/173] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:43 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:43.344676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:43.345577 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:43.352554 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:43.353378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:43.354003 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:43.355637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:43.356626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:43.357176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:43.432171 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:33:43.469243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-86ee2091-0d06-4b0a-bbe0-574099d82dda tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "POST /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.037652 Sep 26 10:33:43.470715 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 88/174] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:33:42 2022] POST /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:33:43.570784 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:43.583326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b0a4b73d-1d4b-4b9f-84ac-15649484eeb2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.242738 Sep 26 10:33:43.584115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 87/175] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:43 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:43.633491 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:43.637432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:43.650612 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:43.651923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:43.652558 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:43.653352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:43.653810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:43.654262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:43.867214 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:43.879522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-339ea54b-f896-4fae-85f0-bce2d04725f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1363 microversion: 2.1 time: 0.253150 Sep 26 10:33:43.882469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 89/176] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:43 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1363 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:44.203521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-180ae8af-05e7-471f-8239-6f783505ac40 req-e9220a91-df35-4de0-b441-603d633a538a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcde70f-d1b6-40ce-8bcd-d17b1986f320", "name": "network-vif-plugged", "status": "completed", "tag": "75ba1d3d-2195-4f53-bc3d-9641a06aa644"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:44.213443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-180ae8af-05e7-471f-8239-6f783505ac40 req-e9220a91-df35-4de0-b441-603d633a538a service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.214646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-180ae8af-05e7-471f-8239-6f783505ac40 req-e9220a91-df35-4de0-b441-603d633a538a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.215173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-180ae8af-05e7-471f-8239-6f783505ac40 req-e9220a91-df35-4de0-b441-603d633a538a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.227071 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-180ae8af-05e7-471f-8239-6f783505ac40 req-e9220a91-df35-4de0-b441-603d633a538a service nova] Creating event network-vif-plugged:75ba1d3d-2195-4f53-bc3d-9641a06aa644 for instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 on hv-cinder-84456 Sep 26 10:33:44.232922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-180ae8af-05e7-471f-8239-6f783505ac40 req-e9220a91-df35-4de0-b441-603d633a538a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032958 Sep 26 10:33:44.235003 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 88/177] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:33:44.366078 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:44.366761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:44.374847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.376132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.376747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.377653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.378258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.378687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.608730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:44.609789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:44.617649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.623820 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.624356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.625118 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.627250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.627978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.905139 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:44.913111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-481d2949-c635-4283-bd38-32c02041b669 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1322 microversion: 2.1 time: 0.552615 Sep 26 10:33:44.917309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 90/178] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:44 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:44.927928 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:44.928559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:44.940805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.941575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.942197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.943027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:44.943761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:44.944321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:44.998494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:45.018174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-02ce1eb6-019f-4c6e-8334-f070c6b02db2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.414016 Sep 26 10:33:45.023326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 89/179] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:44 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:45.355860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:45.368873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4528b276-7864-422d-8b51-e62e3cdb2739 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1549 microversion: 2.1 time: 0.450433 Sep 26 10:33:45.370092 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 91/180] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:44 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1549 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:45.396008 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:45.396643 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:45.406625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:45.407357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:45.408005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:45.408879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:45.409608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:45.410724 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:45.541072 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-de772779-4c5d-4e4c-ba32-011d3753565a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151570 Sep 26 10:33:45.544544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 90/181] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:33:45 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:45.946288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:45.947337 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:45.957225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:45.957948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:45.958401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:45.959349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:45.959803 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:45.960415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.053860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:46.062123 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:46.069105 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:46.069889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:46.071174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.071814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:46.072477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:46.073780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.132895 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:46.160284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b8bf98ca-e9b9-41b9-b71d-aadc59280d2b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1515 microversion: 2.1 time: 0.218876 Sep 26 10:33:46.171583 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 92/182] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:45 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1515 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:46.192222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:46.201987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:46.217294 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:46.218088 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:46.219908 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.220739 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:46.222631 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:46.224130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.267309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:46.277578 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'flavor' on Instance uuid 85ae4608-c737-41ca-83a0-2fab0aebd65f {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:33:46.279780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-947aacd7-7ef3-4b41-99b7-1e26eabe9a7e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.232249 Sep 26 10:33:46.281136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 91/183] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:46 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:46.427060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1005ea1e-72a2-48a9-9a78-255c7c9d9c75 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f/action" status: 200 len: 32 microversion: 2.1 time: 0.244478 Sep 26 10:33:46.428047 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 93/184] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:33:46 2022] POST /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:33:46.439951 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:46.442949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:46.452828 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:46.453796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:46.454643 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.456009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:46.456690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:46.457356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:46.692383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:46.709344 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-45da420d-82f0-4636-a457-104305ebe6cd tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.270954 Sep 26 10:33:46.728251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 92/185] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:46 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:47.318277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:47.320666 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:47.340813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:47.341215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:47.341672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:47.349961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:47.350547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:47.351000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:47.619593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:47.632428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-91d619f5-c027-4e85-9fd9-61adf82ef77f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1367 microversion: 2.1 time: 0.330436 Sep 26 10:33:47.636495 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 94/186] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:47 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:47.673542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-aa25a764-312d-4eb2-b883-b061a1e651f7 req-61a035cf-6a3b-4715-91f1-7b4066bbe0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ca6fe02-8975-4daa-a713-5ec2520b2d67", "tag": "798a1629-515e-41fd-8c26-34ded4b3db4d"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:47.697650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-aa25a764-312d-4eb2-b883-b061a1e651f7 req-61a035cf-6a3b-4715-91f1-7b4066bbe0b1 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:47.698740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-aa25a764-312d-4eb2-b883-b061a1e651f7 req-61a035cf-6a3b-4715-91f1-7b4066bbe0b1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:47.699182 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-aa25a764-312d-4eb2-b883-b061a1e651f7 req-61a035cf-6a3b-4715-91f1-7b4066bbe0b1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:47.713074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-aa25a764-312d-4eb2-b883-b061a1e651f7 req-61a035cf-6a3b-4715-91f1-7b4066bbe0b1 service nova] Creating event network-changed:798a1629-515e-41fd-8c26-34ded4b3db4d for instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 on hv-cinder-84456 Sep 26 10:33:47.719090 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-aa25a764-312d-4eb2-b883-b061a1e651f7 req-61a035cf-6a3b-4715-91f1-7b4066bbe0b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067750 Sep 26 10:33:47.720385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 93/187] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:33:47.755728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:47.759612 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:47.796013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:47.799225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:47.803732 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:47.806335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:47.808149 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:47.808745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:48.078858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:48.091734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cb44ad56-4267-4251-bc82-3410d9d930e6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.349791 Sep 26 10:33:48.093112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 95/188] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:47 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:48.661737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:48.662462 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:48.677209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:48.677997 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:48.678243 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:48.682366 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:48.682893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:48.683585 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:49.104675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:49.115463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-547e83c6-0c04-4a39-9fbf-e1e538b65b83 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1557 microversion: 2.1 time: 0.458293 Sep 26 10:33:49.116045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 94/189] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:48 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1557 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:49.121060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:49.121608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:49.134598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:49.136358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:49.137013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:49.139624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:49.141479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:49.142948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:49.148346 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:49.158247 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:49.168192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:49.168192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:49.168721 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:49.170131 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:49.180639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:49.180898 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:49.498942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7767925c-8f1b-4827-ad4d-99fe4dbcfae6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.354882 Sep 26 10:33:49.499700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 95/190] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:33:49 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-interface => generated 284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:49.959392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:49.973702 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f0fb9e53-3fc2-42c2-94b6-67715b7480e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.858037 Sep 26 10:33:49.995519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 96/191] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:49 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:33:51.002596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:51.003272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:51.012908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:51.013413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:51.013855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:51.016077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:51.016553 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:51.016994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:51.262620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:51.274257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b6611d69-fc2d-4045-9f77-eb96d73c6f15 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.275470 Sep 26 10:33:51.275130 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 96/192] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:50 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:51.357557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-4be5d9f4-6dd3-4efc-a34b-1d7dfda4d6db req-a1791477-e5d7-47ab-9e51-a67a22f786f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbcde70f-d1b6-40ce-8bcd-d17b1986f320", "tag": "75ba1d3d-2195-4f53-bc3d-9641a06aa644"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:33:51.373018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4be5d9f4-6dd3-4efc-a34b-1d7dfda4d6db req-a1791477-e5d7-47ab-9e51-a67a22f786f6 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:51.373501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4be5d9f4-6dd3-4efc-a34b-1d7dfda4d6db req-a1791477-e5d7-47ab-9e51-a67a22f786f6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:51.377183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4be5d9f4-6dd3-4efc-a34b-1d7dfda4d6db req-a1791477-e5d7-47ab-9e51-a67a22f786f6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:51.392146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-4be5d9f4-6dd3-4efc-a34b-1d7dfda4d6db req-a1791477-e5d7-47ab-9e51-a67a22f786f6 service nova] Creating event network-changed:75ba1d3d-2195-4f53-bc3d-9641a06aa644 for instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 on hv-cinder-84456 Sep 26 10:33:51.398716 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-4be5d9f4-6dd3-4efc-a34b-1d7dfda4d6db req-a1791477-e5d7-47ab-9e51-a67a22f786f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045481 Sep 26 10:33:51.399638 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 97/193] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:33:52.302117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:52.302734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:52.308764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:52.309259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:52.309693 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:52.311563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:52.312823 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:52.313088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:52.526297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:52.536242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a2051137-dd90-4301-8c7a-cad28510990d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.237938 Sep 26 10:33:52.536810 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 97/194] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:52 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:53.560484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:53.562853 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:53.573125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:53.574083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:53.574724 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:53.575632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:53.576271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:53.576890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:53.737001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:53.746185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ff8f5010-41bd-466f-acb5-76e88eef25a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.190569 Sep 26 10:33:53.746803 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 98/195] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:53 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:54.773968 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:54.774671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:54.781505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:54.781989 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:54.782493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:54.783195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:54.783707 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:54.784127 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:54.917906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:54.925575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2f6c41c0-a6ef-46bc-849c-c3c0aa515ae2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.155391 Sep 26 10:33:54.926213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 98/196] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:54 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:55.950103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:55.950755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:55.957176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:55.957664 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:55.958140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:55.958832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:55.959291 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:55.959719 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:56.403568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:56.416139 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e06dd608-aa5b-4201-9af2-2c78f6a97705 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.470241 Sep 26 10:33:56.433076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 99/197] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:55 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:56.856624 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:56.857118 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:56.864566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:56.865113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:56.865640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:56.866427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:56.866953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:56.867467 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:56.893915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:33:56.990353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f2525fbc-8769-49ba-a391-3b062a89cc69 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 204 len: 0 microversion: 2.1 time: 0.137129 Sep 26 10:33:56.991319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 99/198] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:33:56 2022] DELETE /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:33:56.999889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:57.000508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:57.006971 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:57.007497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:57.007936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:57.008621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:57.009072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:57.009492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:57.153416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:57.161721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-314c3152-6bb9-456e-9854-1d3844a4712d tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.166296 Sep 26 10:33:57.162626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 100/199] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:56 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:57.442339 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:57.443144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:57.449690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:57.450347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:57.450907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:57.451548 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:57.452028 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:57.452403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:57.619718 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:57.630594 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-60ef9682-5820-4102-81db-cb49b1fea616 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.192450 Sep 26 10:33:57.631352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 100/200] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:57 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:58.184537 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:58.185274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:58.192103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:58.192606 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:58.193044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:58.193733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:58.194382 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:58.194810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:58.330514 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:58.339869 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-eaf2bf6e-d98c-47d0-a15b-6ecc952bcc2a tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.159112 Sep 26 10:33:58.340954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 101/201] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:58 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:58.655482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:58.656090 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:58.662259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:58.663090 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:58.663528 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:58.664272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:58.664716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:58.665131 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:58.805974 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:58.815716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-08f0dd6b-3ec0-4418-a1fb-67daf60ebaa5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.164680 Sep 26 10:33:58.816386 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 101/202] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:58 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:59.364056 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:59.364847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:59.372221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:59.372775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:59.373272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:59.374033 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:59.374932 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:59.375518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:59.514460 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:33:59.522793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b56dd3ad-d7d1-4db0-a8c1-0367f17db445 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.162739 Sep 26 10:33:59.523367 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 102/203] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:59 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:33:59.843172 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:33:59.843778 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:33:59.849904 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:59.850480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:59.850853 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:59.851538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:33:59.851998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:33:59.852418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:33:59.997173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:00.005064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-762727b6-d220-447e-a51f-150e7042f3f7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.166164 Sep 26 10:34:00.005625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 102/204] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:33:59 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:00.546795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:00.547410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:00.553679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:00.554205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:00.554653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:00.555346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:00.555799 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:00.556219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:00.691926 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:00.694642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:00.704116 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7f9143a3-43de-4075-8eae-2043c510e224 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.161108 Sep 26 10:34:00.704689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 103/205] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:00 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:01.030578 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:01.031192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:01.038074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:01.038074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:01.038074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:01.038590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:01.039258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:01.039688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:01.215091 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:01.217780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:01.240049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7fac49b1-f871-4e29-9f89-34ef5558931b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.199599 Sep 26 10:34:01.242432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:01 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:01.729844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:01.730753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:01.733565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=70 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:01.740689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:01.741283 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:01.741792 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:01.742580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:01.743241 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:01.744003 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:01.915791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:01.925884 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0b313d81-4e9c-4daf-bad4-9f4e21c746db tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.200541 Sep 26 10:34:01.926520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 104/207] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:01 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:02.267035 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:02.267639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:02.274878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:02.276902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:02.277344 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:02.278062 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:02.278522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:02.278947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:02.415139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:02.423595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1fd56290-3416-4805-9e39-5b704e044fdf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.160407 Sep 26 10:34:02.424162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 104/208] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:02 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:02.949132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:02.949750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:02.956192 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:02.956676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:02.957112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:02.957806 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:02.958381 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:02.958728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:03.105597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:03.114835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5a659508-4489-4b93-9a5b-b65e57b5ccb1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.170052 Sep 26 10:34:03.115514 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 105/209] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:02 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:03.447046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:03.447586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:03.454342 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:03.454830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:03.455262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:03.455950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:03.456400 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:03.456819 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:03.585597 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:03.593113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-083aa37c-c8af-4655-80bf-257bce0e27cc tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.150052 Sep 26 10:34:03.593680 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:03 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:04.138451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:04.139065 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:04.145457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:04.145957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:04.146424 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:04.147113 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:04.147566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:04.147987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:04.286397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:04.296606 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b6dc7a70-9a20-4d20-ace6-f00eba96da5f tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1553 microversion: 2.1 time: 0.161961 Sep 26 10:34:04.297180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 106/211] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:04 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:04.616483 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:04.617204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:04.623084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:04.623639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:04.624139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:04.624890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:04.625407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:04.625913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:04.896214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:04.905571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d3bdab9b-0615-4db6-9405-57829b7e00ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.292847 Sep 26 10:34:04.911710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 106/212] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:04 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:05.299260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-1e55982f-e8e9-4472-834b-5f6823588002 req-5e8fa072-db57-4675-9dc1-8c13f41d9cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4369a14-7525-4b86-8326-047357bac1f6", "name": "network-vif-deleted", "tag": "1cf8afa5-f1f4-450a-b7df-1e8c12b24cb9"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:05.328517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1e55982f-e8e9-4472-834b-5f6823588002 req-5e8fa072-db57-4675-9dc1-8c13f41d9cc7 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:05.329025 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1e55982f-e8e9-4472-834b-5f6823588002 req-5e8fa072-db57-4675-9dc1-8c13f41d9cc7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:05.329643 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1e55982f-e8e9-4472-834b-5f6823588002 req-5e8fa072-db57-4675-9dc1-8c13f41d9cc7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:05.330915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:05.331936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:05.341881 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:05.342797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:05.343418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:05.344304 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:05.344894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:05.345844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:05.364260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-1e55982f-e8e9-4472-834b-5f6823588002 req-5e8fa072-db57-4675-9dc1-8c13f41d9cc7 service nova] Creating event network-vif-deleted:1cf8afa5-f1f4-450a-b7df-1e8c12b24cb9 for instance f4369a14-7525-4b86-8326-047357bac1f6 on hv-cinder-84456 Sep 26 10:34:05.376267 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-1e55982f-e8e9-4472-834b-5f6823588002 req-5e8fa072-db57-4675-9dc1-8c13f41d9cc7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081385 Sep 26 10:34:05.376921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 107/213] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:05.466533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '398f3e872ad9499fbb26cc48ca9544d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64a07f1fc58419e8dbd23d28a43e98b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:05.480394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8902d13e-110b-4837-9f98-500af1c72397 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 200 len: 1345 microversion: 2.1 time: 0.163452 Sep 26 10:34:05.483423 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 107/214] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:05 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 1345 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:05.929754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:05.930666 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:05.937510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:05.938111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:05.938632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:05.939725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:05.940258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:05.940780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:06.110510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:06.118893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9366bd9a-07db-4e9e-aec1-9425b3e53648 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.193502 Sep 26 10:34:06.120068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 108/215] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:05 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:06.509994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:06.512793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:06.523732 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:06.524370 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:06.524902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:06.525881 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:06.526640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:06.527151 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:06.545335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] HTTP exception thrown: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Request method failure captured: Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 HTTP/1.1 Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_GhAN64aja9ZHHzmdNwDwvXf6fQwtLaJN6ewasiDDCIm1kaSm-6-AGSzCYPnxytJEuB7rQjgnf3-WBpLy9Gyv4UwWe0qj1VBwsjiQLmUye_NdoG1kk8CQ2SM3TKFoTeo78Xl0hD8AYnHzUL5_hmh2omujM9B9-raSOi6O7jt3iRKw Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:34:06.553844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c64a07f1fc58419e8dbd23d28a43e98b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 398f3e872ad9499fbb26cc48ca9544d8 Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.555396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': 'f4369a14-7525-4b86-8326-047357bac1f6'} Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:34:06.556184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.557955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.559061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Returning 404 to user: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:34:06.567422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-75b2837e-a75f-41f8-a2d4-ca5324ed46b6 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 404 len: 111 microversion: 2.1 time: 0.064225 Sep 26 10:34:06.568565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 108/216] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:06 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:34:06.760330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:06.762599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:06.769463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:06.769956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:06.770450 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:06.771205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:06.771664 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:06.772072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:06.786572 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] HTTP exception thrown: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Request method failure captured: Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6/os-volume_attachments HTTP/1.1 Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_GhAN64aja9ZHHzmdNwDwvXf6fQwtLaJN6ewasiDDCIm1kaSm-6-AGSzCYPnxytJEuB7rQjgnf3-WBpLy9Gyv4UwWe0qj1VBwsjiQLmUye_NdoG1kk8CQ2SM3TKFoTeo78Xl0hD8AYnHzUL5_hmh2omujM9B9-raSOi6O7jt3iRKw Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:34:06.794761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c64a07f1fc58419e8dbd23d28a43e98b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 398f3e872ad9499fbb26cc48ca9544d8 Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.795930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'server_id': 'f4369a14-7525-4b86-8326-047357bac1f6'} Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:34:06.796918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:06.798183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:06.799546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Returning 404 to user: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:34:06.799546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8f4e959f-d89e-4fcd-a83a-145006b3584b tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039677 Sep 26 10:34:06.799546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 109/217] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:34:06 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:34:07.142116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:07.142741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:07.148666 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:07.149179 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:07.149628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:07.150336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:07.150788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:07.151734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:07.280911 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:07.289148 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f0aeb43b-cb0c-4a4f-9a09-73ded3785530 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.150911 Sep 26 10:34:07.289715 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 109/218] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:07 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:08.089002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:08.089602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:08.099425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:08.100605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:08.101375 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:08.102469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:08.103084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:08.103508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:08.118848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] HTTP exception thrown: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Request method failure captured: Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 HTTP/1.1 Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_GhAN64aja9ZHHzmdNwDwvXf6fQwtLaJN6ewasiDDCIm1kaSm-6-AGSzCYPnxytJEuB7rQjgnf3-WBpLy9Gyv4UwWe0qj1VBwsjiQLmUye_NdoG1kk8CQ2SM3TKFoTeo78Xl0hD8AYnHzUL5_hmh2omujM9B9-raSOi6O7jt3iRKw Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:34:08.121526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c64a07f1fc58419e8dbd23d28a43e98b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 398f3e872ad9499fbb26cc48ca9544d8 Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.123007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': 'f4369a14-7525-4b86-8326-047357bac1f6'} Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:34:08.127795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.129150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.130432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Returning 404 to user: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:34:08.130432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9eb29d85-63bd-4237-aad9-1db3d6bbf21c tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 404 len: 111 microversion: 2.1 time: 0.038236 Sep 26 10:34:08.130432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 110/219] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:34:08 2022] DELETE /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:34:08.132604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:08.133214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] [instance: f4369a14-7525-4b86-8326-047357bac1f6] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:08.139753 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:08.140241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:08.140676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:08.141359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:08.141981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:08.142434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:08.155749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] HTTP exception thrown: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Request method failure captured: Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 HTTP/1.1 Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_GhAN64aja9ZHHzmdNwDwvXf6fQwtLaJN6ewasiDDCIm1kaSm-6-AGSzCYPnxytJEuB7rQjgnf3-WBpLy9Gyv4UwWe0qj1VBwsjiQLmUye_NdoG1kk8CQ2SM3TKFoTeo78Xl0hD8AYnHzUL5_hmh2omujM9B9-raSOi6O7jt3iRKw Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:34:08.157498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c64a07f1fc58419e8dbd23d28a43e98b", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c64a07f1fc58419e8dbd23d28a43e98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: c64a07f1fc58419e8dbd23d28a43e98b Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-DeleteServersTestJSON-1136205833 Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 398f3e872ad9499fbb26cc48ca9544d8 Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-DeleteServersTestJSON-1136205833-project Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.158959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': 'f4369a14-7525-4b86-8326-047357bac1f6'} Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:34:08.159656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. Sep 26 10:34:08.160787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:08.163032 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] Returning 404 to user: Instance f4369a14-7525-4b86-8326-047357bac1f6 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:34:08.164011 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bf9578e8-f425-41b1-8351-2304af97dcc1 tempest-DeleteServersTestJSON-1136205833 tempest-DeleteServersTestJSON-1136205833-project] 10.222.0.49 "GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6" status: 404 len: 111 microversion: 2.1 time: 0.035435 Sep 26 10:34:08.164578 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 110/220] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:08 2022] GET /compute/v2.1/servers/f4369a14-7525-4b86-8326-047357bac1f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:34:08.315993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:08.317232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:08.333735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:08.335755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:08.336950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:08.338876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:08.340984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:08.341757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:08.605278 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:08.615086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f069e9dc-3efe-4e78-bcf6-b6bdb2d67f32 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.304124 Sep 26 10:34:08.631209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 111/221] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:08 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:09.646431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:09.647348 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:09.657748 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:09.658630 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:09.659709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:09.660723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:09.661417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:09.662187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:09.994737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:10.002277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-299f974c-3470-4e0b-a6ed-62463810cbb0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.366794 Sep 26 10:34:10.003062 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 111/222] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:09 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:11.028276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:11.030269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:11.038379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:11.038881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:11.039324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:11.040567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:11.041256 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:11.042265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:11.219593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:11.232318 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-df22243d-11fc-4b5b-9515-479e7c672bac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.209521 Sep 26 10:34:11.233221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 112/223] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:11 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:12.258839 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:12.259472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:12.269153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:12.276964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:12.277890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:12.287752 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:12.294288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:12.301224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:12.306211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:12.637399 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:12.658326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-00f53c32-4da9-48a5-8788-3148635a9841 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.404891 Sep 26 10:34:12.674249 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 112/224] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:12 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:13.687045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:13.687652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:13.694786 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:13.695799 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:13.696389 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:13.697533 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:13.698541 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:13.698989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:13.963890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:13.983324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a1aa2320-7374-4231-b262-2808eae4faaf tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.300264 Sep 26 10:34:14.025910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 113/225] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:13 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:15.009026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:15.010820 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:15.017641 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:15.020368 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:15.020807 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:15.021516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:15.021967 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:15.022417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:15.240534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:15.249281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-249e3c4e-f9eb-4c2d-9e6f-f0b7bff0e2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.244505 Sep 26 10:34:15.249979 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 113/226] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:15 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:16.276557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:16.278502 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:16.286179 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:16.286948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:16.287601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:16.288508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:16.289166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:16.289833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:16.496438 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:16.525529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-095954b9-c07c-4244-9219-4ece4d505b86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.255114 Sep 26 10:34:16.542122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 114/227] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:16 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:17.551692 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:17.552485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:17.559206 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:17.559974 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:17.560673 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:17.561750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:17.562496 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:17.563137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:17.719031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:17.729181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8a686037-c76b-4edc-807f-f8ff8a61d203 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.181452 Sep 26 10:34:17.730441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 114/228] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:17 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:18.760474 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:18.762508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:18.771892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:18.772758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:18.773453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:18.774907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:18.775711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:18.776422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:19.000274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:19.011071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-bdf1dd83-e0d5-4789-b646-21bc5daf8ab7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.260035 Sep 26 10:34:19.011836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 115/229] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:18 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:19.892198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-579692b4-c195-4546-a90b-78f1c995071e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'create', calling method: .version_select at 0x7fbadb3b8af0>, body: {"keypair": {"name": "tempest-keypair-1684589492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNY7RPQNOU5o1HAEHlxJRO+wc5PSoEPcSEzs898x0Y/E9lNTj8ekYOL28+24m+pFH4RR1DmbpNnAXkkwoVbReH6HYiVUrdBWeA2uNq43JA4uFOmcicbY6HrW08FKkLjyxA=="}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:19.913094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-579692b4-c195-4546-a90b-78f1c995071e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for project 38cccae871b94a9db82b5017c2c497c1. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:34:19.917305 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-579692b4-c195-4546-a90b-78f1c995071e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for user 8c8ebfdad6ab437eb7dda111fee84205 and project 38cccae871b94a9db82b5017c2c497c1. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:34:19.956442 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-579692b4-c195-4546-a90b-78f1c995071e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.205090 Sep 26 10:34:19.957032 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 115/230] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Sep 26 10:34:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 206 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 26 10:34:20.035724 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:20.040549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:20.048680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:20.049442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:20.050169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:20.051269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:20.051969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:20.052903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:20.233564 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:20.243443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7b817bf9-07ff-48a4-8290-2531636e925d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.211554 Sep 26 10:34:20.244705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 116/231] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:20 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:21.268231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:21.268849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:21.274904 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:21.275398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:21.275830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:21.277077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:21.277531 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:21.277957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:21.486184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:21.497546 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d8d7dada-a95b-4861-bf83-99e729999ed9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.230609 Sep 26 10:34:21.498162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 116/232] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:21 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:21.537759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1781029658", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "154a4e25-766b-4e4b-9202-0213b7789f71"}], "security_groups": [{"name": "tempest-securitygroup--1487575446"}], "key_name": "tempest-keypair-1684589492", "user_data": "}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:21.696023 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] validate_networks() for [('154a4e25-766b-4e4b-9202-0213b7789f71', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:34:22.148266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:34:22.148764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:34:22.149331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:34:22.149805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:34:22.150416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:34:22.166152 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:22.167202 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:22.167635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:22.168363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:22.168817 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:22.169275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:22.186436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for project 38cccae871b94a9db82b5017c2c497c1. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:34:22.191214 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for user 8c8ebfdad6ab437eb7dda111fee84205 and project 38cccae871b94a9db82b5017c2c497c1. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:34:22.212791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:34:22.216042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:34:22.267806 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ceb6534c-d4a0-414a-b313-eaca426a5c92 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.733606 Sep 26 10:34:22.269042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 117/233] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Sep 26 10:34:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 10:34:22.280700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b5d266ee-c486-4547-b207-c0dfe255cb9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:22.282054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b5d266ee-c486-4547-b207-c0dfe255cb9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:22.354986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b5d266ee-c486-4547-b207-c0dfe255cb9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:22.367297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b5d266ee-c486-4547-b207-c0dfe255cb9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:22.369408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b5d266ee-c486-4547-b207-c0dfe255cb9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:22.371094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b5d266ee-c486-4547-b207-c0dfe255cb9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1282 microversion: 2.20 time: 0.094883 Sep 26 10:34:22.380115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 117/234] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:22 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:22.523098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:22.523933 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:22.537093 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:22.538141 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:22.539877 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:22.542926 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:22.543602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:22.544257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:22.749884 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:22.759620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-66ae0c23-9cc2-4a03-98d2-cdd670b5e45a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.240682 Sep 26 10:34:22.760203 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 118/235] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:22 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:23.400021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:23.401347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:23.408615 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:23.409295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:23.409716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:23.410423 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:23.411454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:23.412230 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:23.498485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:23.517528 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:23.520635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:23.525453 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f9dbc83c-258a-4863-9860-92dff679573c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1334 microversion: 2.20 time: 0.129151 Sep 26 10:34:23.530343 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 118/236] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:23 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1334 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:23.790147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:23.799434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:23.817706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:23.818282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:23.819069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:23.820349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:23.820834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:23.821274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:24.132124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:24.146788 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ef15b686-ae8b-44f7-85d7-fb98f138f86d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.365644 Sep 26 10:34:24.149750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 119/237] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:23 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:24.560921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:24.561639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:24.570160 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:24.570656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:24.573698 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:24.574429 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:24.574858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:24.575274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:24.667297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:24.678831 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:24.680484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:24.681643 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a091f224-2969-4294-a60d-5e54babca600 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1340 microversion: 2.20 time: 0.126253 Sep 26 10:34:24.690533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 119/238] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:24 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1340 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:25.174688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:25.175330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:25.181623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:25.182156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:25.182597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:25.183287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:25.183745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:25.184171 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:25.326620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:25.334346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-dbdafa14-cdfc-4006-b04c-45df217af097 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.163474 Sep 26 10:34:25.334911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 120/239] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:25 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:25.709492 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:25.710205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:25.727274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:25.729283 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:25.731347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:25.734749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:25.754085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:25.758281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:25.888825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:25.901650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:25.903418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:25.904653 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9e630854-56a5-495a-9919-6fb09727048a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1340 microversion: 2.20 time: 0.200156 Sep 26 10:34:25.905759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 120/240] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:25 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1340 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:26.359339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:26.359939 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:26.372978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:26.373481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:26.373920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:26.374652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:26.375106 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:26.375531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:26.616924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:26.627095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2a4ccd73-2d6c-418e-9ee8-998aa0fc0c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.272664 Sep 26 10:34:26.627683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 121/241] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:26 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:26.931137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:26.931842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:26.938981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:26.939476 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:26.939926 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:26.940635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:26.941186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:26.941549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:27.072390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:27.080663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:27.082204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:27.083307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b50727f0-eb53-4b88-8a5e-27db66e4cfb1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.156341 Sep 26 10:34:27.083855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 121/242] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:26 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:27.650785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:27.652030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:27.658492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:27.658981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:27.659424 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:27.660123 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:27.660580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:27.661008 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:27.997482 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:28.005308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4f7d4d4c-9fb6-47d1-9291-e5af937ad4d6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.358330 Sep 26 10:34:28.005875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 122/243] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:27 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:28.052468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-e3106c82-9fe8-4873-93d7-1dfca5ffddca req-d427c989-2db9-4d87-a573-e7c50392f928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:28.062746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e3106c82-9fe8-4873-93d7-1dfca5ffddca req-d427c989-2db9-4d87-a573-e7c50392f928 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:28.063227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e3106c82-9fe8-4873-93d7-1dfca5ffddca req-d427c989-2db9-4d87-a573-e7c50392f928 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:28.063659 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e3106c82-9fe8-4873-93d7-1dfca5ffddca req-d427c989-2db9-4d87-a573-e7c50392f928 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:28.075488 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-e3106c82-9fe8-4873-93d7-1dfca5ffddca req-d427c989-2db9-4d87-a573-e7c50392f928 service nova] Creating event network-changed:80a6fd45-6996-4b15-93f6-3122e122a647 for instance 05d17109-d4ce-4939-89c1-efb485f67ada on hv-cinder-84456 Sep 26 10:34:28.080953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-e3106c82-9fe8-4873-93d7-1dfca5ffddca req-d427c989-2db9-4d87-a573-e7c50392f928 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Sep 26 10:34:28.081568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 122/244] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:28.109215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:28.109903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:28.115900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:28.116396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:28.116829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:28.117517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:28.117969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:28.118414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:28.122982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:28.252538 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:28.261089 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:28.262644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:28.263745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fa0b9a79-60ae-4c32-bddd-228b89bc8466 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.159205 Sep 26 10:34:28.264290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 123/245] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:28 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:29.028996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:29.029685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:29.035683 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:29.036154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:29.036587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:29.037263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:29.037704 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:29.038142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:29.199140 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:29.207365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0bbdd2d0-7159-45e2-bcbb-2e4e3a2f78f8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.182922 Sep 26 10:34:29.208015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 123/246] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:29 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:29.289530 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:29.290191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:29.296917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:29.297398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:29.297828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:29.298541 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:29.298995 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:29.299417 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:29.436809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:29.445155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:29.446652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:29.448286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-55c2329d-5ad9-44fe-9490-28694b06c471 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.162526 Sep 26 10:34:29.448842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 124/247] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:29 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:30.102957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-459996623", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "networks": [{"uuid": "d7be86fe-8855-4d67-93a3-d5af1e6f3acc"}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:30.157336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] validate_networks() for [('d7be86fe-8855-4d67-93a3-d5af1e6f3acc', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:34:30.234050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:30.235363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:30.243703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:30.244721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:30.245710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:30.246954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:30.247618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:30.248962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:30.553510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:30.562327 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fc0b149a-ae50-4637-9343-d9fea680d09f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1521 microversion: 2.1 time: 0.334429 Sep 26 10:34:30.562918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 125/248] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:30 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:30.567707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:30.568591 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:30.574815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:30.575308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:30.575779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:30.576642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:30.577106 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:30.577538 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:30.893993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:30.897655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:34:30.898186 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:34:30.898690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:34:30.899162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:34:30.899638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:34:30.902612 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:30.904072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:30.905176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a57ad8d5-293c-4e5c-b21e-f628c85c9a13 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.341181 Sep 26 10:34:30.905728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 126/249] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:30 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:30.908358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:30.908829 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:30.909251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:30.909957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:30.910423 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:30.910836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:30.928877 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Getting quotas for project d5804df4a7c54688953727e249ce63e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:34:30.935112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Getting quotas for user d17e9dd3a1224bbcb38ab5135a918df1 and project d5804df4a7c54688953727e249ce63e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:34:30.946007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:34:30.948346 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:34:30.997433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e35053d3-3fec-441c-8db8-ed4f6bf85f5a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898438 Sep 26 10:34:30.999844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 124/250] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:34:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:34:31.009423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-21276a20-e57b-4b60-b3eb-a5f9a58ff5fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:31.010302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-21276a20-e57b-4b60-b3eb-a5f9a58ff5fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:31.077323 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-21276a20-e57b-4b60-b3eb-a5f9a58ff5fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:31.086506 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-21276a20-e57b-4b60-b3eb-a5f9a58ff5fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1213 microversion: 2.1 time: 0.080931 Sep 26 10:34:31.087284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 127/251] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:31 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:31.584898 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:31.585501 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:31.592627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:31.593100 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:31.593529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:31.594285 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:31.594736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:31.595152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:31.597691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=100 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:31.720493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:31.728285 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-706c2697-11ed-4357-88c1-b83319c805f4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1501 microversion: 2.1 time: 0.147296 Sep 26 10:34:31.728848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 125/252] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:31 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1501 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:31.750059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:31.750669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:31.752978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:31.759924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:31.761004 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:31.761598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:31.762335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:31.762835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:31.763264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:31.899948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:31.907529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-62a47540-93af-417a-acd3-3fbc6652d141 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1514 microversion: 2.1 time: 0.161328 Sep 26 10:34:31.908091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 128/253] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:31 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:31.930806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:31.931530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:31.938210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:31.938763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:31.939287 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:31.940060 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:31.940572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:31.941055 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:32.076235 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:32.084783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:32.086272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:32.087375 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-df7c1f06-f0c9-4ea9-bf00-e8a5290b65c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.160630 Sep 26 10:34:32.098386 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 126/254] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:31 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:32.110271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:32.111248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:32.119391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:32.121035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:32.121472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:32.122362 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:32.122850 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:32.123268 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:32.177738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:32.224524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:32.234998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1666c70e-f4ff-485a-a5d2-d7cc4b21e07b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1217 microversion: 2.1 time: 0.128945 Sep 26 10:34:32.236656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 129/255] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:32 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:33.112956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:33.113572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:33.120170 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.120652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.121083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.121787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.122255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.122675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.263344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:33.264685 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:33.273052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.273544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.274000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.274705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.275160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.275584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.362210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:33.365950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:33.372872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:33.374517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:33.375632 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ccd5c09b-3c76-4887-9cef-344901cae5e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.266705 Sep 26 10:34:33.386398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 127/256] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:33 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:33.386568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fe1cd657-09d3-4d61-8b29-679da0468402 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1271 microversion: 2.1 time: 0.121734 Sep 26 10:34:33.386568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 130/257] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:33 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:33.394796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:33.394796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:33.400547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.401038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.401507 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.402257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.402708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.403161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.425624 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'flavor' on Instance uuid 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:34:33.538139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8952aa8e-8fd6-46b7-a4a9-601cb2fd4251 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/action" status: 200 len: 32 microversion: 2.1 time: 0.160403 Sep 26 10:34:33.538984 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 128/258] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:34:33 2022] POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:34:33.548849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:33.549472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:33.555592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.556144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.556526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:33.557767 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:33.558428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:33.558859 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:34.119486 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:34.127396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-879f0768-8c94-42d1-b474-bc5d7ea6d952 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.582684 Sep 26 10:34:34.127967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 131/259] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:33 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:34.403876 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:34.405480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:34.412178 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:34.412954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:34.413433 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:34.413961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:34.414627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:34.415390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:34.416038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:34.416786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:34.419649 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:34.420133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:34.420561 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:34.421254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:34.421880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:34.422329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:34.786459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:34.794670 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1fa6cf22-9703-46bd-9117-26de17860247 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.393849 Sep 26 10:34:34.795688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 132/260] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:34 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:34.819020 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:34.828121 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:34.829562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:34.830689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9460fd60-7fe9-4fc0-98de-abaea9d65e9d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.432114 Sep 26 10:34:34.831242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 129/261] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:34 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:35.150596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:35.151248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:35.157208 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.157693 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.158152 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:35.158836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.160058 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.160481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:35.372027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:35.381058 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9d7b0943-0225-48b3-b69f-6226bc1c9b38 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.234265 Sep 26 10:34:35.381635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 133/262] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:35 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:35.484556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-be8da3f6-c65d-48eb-9599-29b2faa4bb5f req-047c97cf-10bb-401f-a69f-c7bac9a94714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2d2215-b1c9-4d65-981c-fcb3382a5b47", "tag": "0a83d70c-33ba-4cde-b0a9-491ead21e684"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:35.496626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-be8da3f6-c65d-48eb-9599-29b2faa4bb5f req-047c97cf-10bb-401f-a69f-c7bac9a94714 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.497274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-be8da3f6-c65d-48eb-9599-29b2faa4bb5f req-047c97cf-10bb-401f-a69f-c7bac9a94714 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.497961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-be8da3f6-c65d-48eb-9599-29b2faa4bb5f req-047c97cf-10bb-401f-a69f-c7bac9a94714 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:35.521085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-be8da3f6-c65d-48eb-9599-29b2faa4bb5f req-047c97cf-10bb-401f-a69f-c7bac9a94714 service nova] Creating event network-changed:0a83d70c-33ba-4cde-b0a9-491ead21e684 for instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 on hv-cinder-84456 Sep 26 10:34:35.527636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-be8da3f6-c65d-48eb-9599-29b2faa4bb5f req-047c97cf-10bb-401f-a69f-c7bac9a94714 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046990 Sep 26 10:34:35.528708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 130/263] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:35.822894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:35.823555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:35.830231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.830727 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.831165 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:35.832053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.832669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.833274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:35.862416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:35.869059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:35.876574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.877335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.877938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:35.880180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:35.880649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:35.881085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:36.105403 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:36.112194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:36.113006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3db69a75-838f-4e7f-bc6d-355151d472c5 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.294154 Sep 26 10:34:36.113589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 134/264] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:35 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:36.118001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-c2ccecc1-f2f2-46d0-9fbb-a63ab85a7165 req-9359fad7-4ff8-4024-a58b-e0aef3fdf981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "name": "network-vif-plugged", "status": "completed", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:36.120803 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:36.122383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:36.123551 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6d2cb64e-3b1c-4e7b-8592-827f197af27f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.270002 Sep 26 10:34:36.124306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 131/265] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:35 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:36.129352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-c2ccecc1-f2f2-46d0-9fbb-a63ab85a7165 req-9359fad7-4ff8-4024-a58b-e0aef3fdf981 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:36.129352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-c2ccecc1-f2f2-46d0-9fbb-a63ab85a7165 req-9359fad7-4ff8-4024-a58b-e0aef3fdf981 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:36.129352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-c2ccecc1-f2f2-46d0-9fbb-a63ab85a7165 req-9359fad7-4ff8-4024-a58b-e0aef3fdf981 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:36.139619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-c2ccecc1-f2f2-46d0-9fbb-a63ab85a7165 req-9359fad7-4ff8-4024-a58b-e0aef3fdf981 service nova] Creating event network-vif-plugged:80a6fd45-6996-4b15-93f6-3122e122a647 for instance 05d17109-d4ce-4939-89c1-efb485f67ada on hv-cinder-84456 Sep 26 10:34:36.144563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-c2ccecc1-f2f2-46d0-9fbb-a63ab85a7165 req-9359fad7-4ff8-4024-a58b-e0aef3fdf981 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 Sep 26 10:34:36.145138 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 135/266] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:36.404133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:36.404735 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:36.410706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:36.411901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:36.411901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:36.412477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:36.412992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:36.413483 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:36.553828 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:36.562542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4b857d97-6389-4b89-88e0-1f8f195542c9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.162226 Sep 26 10:34:36.563113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 132/267] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:36 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:37.136984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:37.138452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:37.146778 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:37.148847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:37.149585 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:37.149772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:37.150231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:37.151333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:37.151931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:37.152550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:37.156672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:37.157165 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:37.157604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:37.158334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:37.158795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:37.159221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:37.363637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:37.367676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:37.372236 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:37.373700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:37.374827 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6c1da62c-c8ed-402c-bcdf-e7888859d228 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.229065 Sep 26 10:34:37.375393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 133/268] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:37 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:34:37.376032 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ca408b6a-5ccd-46e4-9411-5cf770feb316 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.244462 Sep 26 10:34:37.376677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 136/269] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:37 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:37.585969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:37.586596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:37.592441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:37.592913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:37.593339 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:37.594011 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:37.594484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:37.594901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:37.720116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:37.728534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f28eb8ea-228d-411f-b0a7-1de094e9ca56 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.146378 Sep 26 10:34:37.729109 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 134/270] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:37 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:38.399541 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:38.400217 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:38.400479 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:38.401092 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:38.407791 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:38.408273 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:38.408501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:38.408706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:38.409016 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:38.409413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:38.409522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:38.409919 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:38.410232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:38.410377 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:38.410681 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:38.411101 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:38.615141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:38.619265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:38.623755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:38.625224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:38.626351 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a0c9879f-f37d-41ea-a703-35b44895ca72 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.230134 Sep 26 10:34:38.626923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 135/271] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:38 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:34:38.627738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4c85c788-27d0-4425-b010-838c3e6b8a9f tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.232093 Sep 26 10:34:38.628457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 137/272] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:38 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:38.752235 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:38.752829 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:38.758652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:38.759138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:38.759574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:38.760260 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:38.760708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:38.761133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:38.893442 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:38.900950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-416feca8-3166-42a0-9b86-34614e6b9328 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.152591 Sep 26 10:34:38.901519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 136/273] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:38 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:39.651166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:39.651738 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:39.652151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:39.652802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:39.658622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:39.658766 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:39.659101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:39.659200 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:39.659529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:39.659622 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:39.660210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:39.660304 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:39.660655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:39.660744 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:39.661077 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:39.661166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:39.957606 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:39.966297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c4f05dde-d194-459e-a0e7-b06877fd6125 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.318942 Sep 26 10:34:39.966897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 138/274] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:39 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:39.978190 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:39.978190 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:39.980267 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:39.980765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:39.981853 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:39.982755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:39.983221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:39.983652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:40.000505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:40.009834 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:40.011601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:40.013442 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-22bafe52-af3c-4b9c-86c3-5c7c5c4713e4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.365777 Sep 26 10:34:40.014389 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 137/275] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:39 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:34:40.185322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:40.193136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2ea51c19-d257-4d5f-a75d-80293cd71b5d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.225271 Sep 26 10:34:40.193708 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 139/276] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:39 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:40.990060 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:40.990663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:40.992560 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:40.993212 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=12 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:40.998875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:40.999350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:40.999777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:41.000448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:41.000892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:41.001309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:41.039071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:41.039691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:41.047197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:41.047687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:41.048124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:41.048832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:41.049284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:41.049707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:41.085752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=8 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:41.221741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:41.230111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:41.231625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:41.232722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4a1ad086-9164-4ce6-ad58-bd318dbc096c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1408 microversion: 2.20 time: 0.197735 Sep 26 10:34:41.233281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 140/277] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:41 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:34:41.237609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:41.238240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:41.243918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:41.244402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:41.244834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:41.245513 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:41.246005 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:41.246451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:41.261096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:41.286941 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:41.294691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-14312b41-16cd-4bb9-acef-929f5aba913e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.308412 Sep 26 10:34:41.295266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 138/278] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:40 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:41.380481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:41.388627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-76fadd38-2de5-4fda-a600-6e93114d6eac tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.154422 Sep 26 10:34:41.389194 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 141/279] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:41 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:42.046862 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-50cb297f-a253-4632-a78a-d245d74311d7 req-5e60f1b7-9f84-4254-95b5-237584c4f100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2d2215-b1c9-4d65-981c-fcb3382a5b47", "name": "network-vif-plugged", "status": "completed", "tag": "0a83d70c-33ba-4cde-b0a9-491ead21e684"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:42.057388 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-50cb297f-a253-4632-a78a-d245d74311d7 req-5e60f1b7-9f84-4254-95b5-237584c4f100 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.057854 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-50cb297f-a253-4632-a78a-d245d74311d7 req-5e60f1b7-9f84-4254-95b5-237584c4f100 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.058452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-50cb297f-a253-4632-a78a-d245d74311d7 req-5e60f1b7-9f84-4254-95b5-237584c4f100 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.071377 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-50cb297f-a253-4632-a78a-d245d74311d7 req-5e60f1b7-9f84-4254-95b5-237584c4f100 service nova] Creating event network-vif-plugged:0a83d70c-33ba-4cde-b0a9-491ead21e684 for instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 on hv-cinder-84456 Sep 26 10:34:42.076689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-50cb297f-a253-4632-a78a-d245d74311d7 req-5e60f1b7-9f84-4254-95b5-237584c4f100 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034094 Sep 26 10:34:42.077575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 139/280] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:42.259549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:42.261018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:42.273137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.273756 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.274470 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.278416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.281775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.282373 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.319453 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:42.320150 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:42.331390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.331865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.332304 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.333038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.336560 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.337161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.543637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:42.551707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:42.553210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:42.554444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f3166b4a-3d73-41ae-9189-e934b20218ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1600 microversion: 2.20 time: 0.300256 Sep 26 10:34:42.555000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 142/281] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:34:42 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1600 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:34:42.566686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:42.566686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:42.566686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.566967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.567209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.567903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.568359 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.568790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.586321 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:42.593972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b796b35a-e499-478f-b8d3-2387f0f6dfc8 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.279728 Sep 26 10:34:42.594555 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 140/282] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:42 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:42.599114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:42.599588 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:42.601629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:42.607158 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.607827 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.608402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.609250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:42.609843 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:42.610579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:42.613929 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:42.716782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fb3a136d-1094-4054-ab5b-cb5c70659b4b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121166 Sep 26 10:34:42.717407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 141/283] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Sep 26 10:34:42 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:34:42.745457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:42.753122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ceefb8d3-0dcd-488d-8997-acb15f9cec1e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.197176 Sep 26 10:34:42.753688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 143/284] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:42 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:43.307730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:43.308276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:43.314973 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.315461 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.315900 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.316625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.317112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.317539 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.342572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b862a6e0-cf7c-4f18-9ce3-1c8a6ed3bac7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/ips" status: 200 len: 146 microversion: 2.1 time: 0.038661 Sep 26 10:34:43.343573 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 142/285] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:34:43 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:43.618764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:43.619452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:43.626526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.627199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.627816 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.628870 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.629491 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.630228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.651708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-c6cdca46-0a60-498f-b61b-b59adaae17c5 req-cb7675ab-9547-455c-a1be-76f42acc163e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:43.662454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c6cdca46-0a60-498f-b61b-b59adaae17c5 req-cb7675ab-9547-455c-a1be-76f42acc163e service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.662934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c6cdca46-0a60-498f-b61b-b59adaae17c5 req-cb7675ab-9547-455c-a1be-76f42acc163e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.663363 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c6cdca46-0a60-498f-b61b-b59adaae17c5 req-cb7675ab-9547-455c-a1be-76f42acc163e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.681295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-c6cdca46-0a60-498f-b61b-b59adaae17c5 req-cb7675ab-9547-455c-a1be-76f42acc163e service nova] Creating event network-changed:80a6fd45-6996-4b15-93f6-3122e122a647 for instance 05d17109-d4ce-4939-89c1-efb485f67ada on hv-cinder-84456 Sep 26 10:34:43.687266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-c6cdca46-0a60-498f-b61b-b59adaae17c5 req-cb7675ab-9547-455c-a1be-76f42acc163e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039063 Sep 26 10:34:43.688548 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 143/286] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:34:43.779796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:43.780751 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:43.794686 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.795614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.796233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.797137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:43.797763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:43.798229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:43.849844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:43.862576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-52c1922d-72a2-4e2b-96fd-a354f651d273 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1313 microversion: 2.1 time: 0.248201 Sep 26 10:34:43.879387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 144/287] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:43 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:43.962956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:43.971121 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-47c1f764-b782-42ba-bdeb-a8cb692b295b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.198051 Sep 26 10:34:43.971701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 144/288] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:43 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:44.887515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:44.888122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:44.894440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:44.894919 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:44.895355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:44.896030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:44.896483 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:44.896905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:44.995220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:44.995857 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:45.002530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:45.003014 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:45.003445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:45.004141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:45.004587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:45.005012 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:45.023269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:45.031046 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4f187d05-9127-4201-8b21-72fad6f07c6a tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1496 microversion: 2.1 time: 0.147605 Sep 26 10:34:45.031737 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 145/289] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:44 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1496 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:45.139409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:45.147091 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f484f8f5-0d56-46ed-834f-40b3a9d8491c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.155711 Sep 26 10:34:45.147644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 145/290] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:44 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:46.170266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:46.170790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:46.177140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:46.177620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:46.178071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:46.178753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:46.179199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:46.179620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:46.305467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:46.313556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-68f7f098-2572-4453-a900-a8553c8f8be3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.147304 Sep 26 10:34:46.314137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 146/291] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:46 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:47.336896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:47.337547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:47.344633 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.345115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.345538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.346255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.346701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.347115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.504992 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:47.505604 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:47.513419 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.514268 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.514711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.515426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.515881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.516461 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.543741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:34:47.649769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-bf7f7518-a6a5-4e86-b245-94bd4f4a8473 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 204 len: 0 microversion: 2.1 time: 0.148394 Sep 26 10:34:47.651542 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 147/292] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:34:47 2022] DELETE /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:34:47.657626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:47.659345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:47.667284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.667806 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.668268 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.669041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.669511 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.670156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.699478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e0180c19-6587-473f-8f12-8128dcb725bc tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/ips" status: 200 len: 150 microversion: 2.1 time: 0.046463 Sep 26 10:34:47.700834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 148/293] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:34:47 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:47.705642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:47.706279 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:47.713044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.713563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.713956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.715238 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:47.716471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:47.716786 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:47.874358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:47.883023 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6f2fa76f-a3dd-4ec6-a0bc-7efc20c8cda6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.549980 Sep 26 10:34:47.883749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 146/294] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:47 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:47.990754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:48.000725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6c8fa66e-9735-45cf-91d4-6257c3d1b3c4 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1502 microversion: 2.1 time: 0.298519 Sep 26 10:34:48.001088 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 149/295] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:47 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:48.913443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:48.914115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:48.920274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:48.920757 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:48.921184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:48.921877 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:48.922354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:48.922783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:48.944338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f1cfbe9-4856-490c-857d-a290d414f5c7"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:48.946716 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:48.953895 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:48.955041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:48.955488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:48.956201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:48.956655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:48.957083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:49.077802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:49.086475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1ac4e272-6dd8-4101-a961-133ae6770db2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.177162 Sep 26 10:34:49.087036 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 147/296] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:48 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:49.095565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:49.096173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:49.102489 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:49.102965 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:49.103390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:49.104110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:49.104614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:49.105035 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:49.456426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4e9a9ba5-b25b-4d94-a79c-b1a42df7caf2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.515895 Sep 26 10:34:49.457623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 150/297] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:34:48 2022] POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:34:49.468247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2a3775a-385c-4759-8ee1-cbdc8413a7f9"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:49.475640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:49.480840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:49.488949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-42c9d411-23dc-4dce-b4e1-f9e103f73553 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1502 microversion: 2.1 time: 0.400347 Sep 26 10:34:49.494304 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 148/298] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:49 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:49.499733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:49.500765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:49.501882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:49.503144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:49.503678 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:49.504208 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:49.879985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-145bfe9e-868b-460a-ad99-af44ebf8d21e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420668 Sep 26 10:34:49.880908 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 151/299] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:34:49 2022] POST /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments => generated 194 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:50.110650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:50.111365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:50.117155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:50.117725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:50.118194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:50.118910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:50.119397 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:50.119785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:50.272740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:50.281045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1fb8d6ba-db7f-441c-b191-f577a688819c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.174257 Sep 26 10:34:50.281602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 149/300] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:50 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:50.318956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-38acd316-0e95-4e0f-9cd6-8515dc1c6d73 req-30666f3b-d77d-4d17-b987-7a610dce6330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2d2215-b1c9-4d65-981c-fcb3382a5b47", "name": "network-vif-deleted", "tag": "0a83d70c-33ba-4cde-b0a9-491ead21e684"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:50.328821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-38acd316-0e95-4e0f-9cd6-8515dc1c6d73 req-30666f3b-d77d-4d17-b987-7a610dce6330 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:50.329299 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-38acd316-0e95-4e0f-9cd6-8515dc1c6d73 req-30666f3b-d77d-4d17-b987-7a610dce6330 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:50.329729 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-38acd316-0e95-4e0f-9cd6-8515dc1c6d73 req-30666f3b-d77d-4d17-b987-7a610dce6330 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:50.341039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-38acd316-0e95-4e0f-9cd6-8515dc1c6d73 req-30666f3b-d77d-4d17-b987-7a610dce6330 service nova] Creating event network-vif-deleted:0a83d70c-33ba-4cde-b0a9-491ead21e684 for instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 on hv-cinder-84456 Sep 26 10:34:50.346042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-38acd316-0e95-4e0f-9cd6-8515dc1c6d73 req-30666f3b-d77d-4d17-b987-7a610dce6330 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031526 Sep 26 10:34:50.346644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 152/301] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:34:50.521760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:50.522680 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:50.529497 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:50.529995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:50.530445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:50.531310 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:50.531761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:50.532340 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:50.564817 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:50.565379 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:50.565699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:50.566242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lazy-loading 'fault' on Instance uuid 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:34:50.616961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:50.629640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5171d954-ddd6-4667-8bd9-4d6382bd9e3e tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1303 microversion: 2.1 time: 0.112497 Sep 26 10:34:50.630736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 150/302] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:50 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:51.305881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:51.306723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:51.313948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:51.314534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:51.314985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:51.315700 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:51.316157 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:51.316584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:51.453969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:51.461674 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-de999574-4dba-408b-bf49-bea38e9c515f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.160613 Sep 26 10:34:51.462391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 153/303] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:51 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:51.664993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:51.665612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:51.681334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:51.682132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:51.682947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:51.683785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:51.684873 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:51.685498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:51.728452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:51.728939 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:51.729367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:51.729809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lazy-loading 'fault' on Instance uuid 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:34:51.781752 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:51.790875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ad0234dc-0a87-41d6-b6e5-2179d51147be tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 200 len: 1303 microversion: 2.1 time: 0.130687 Sep 26 10:34:51.791469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 151/304] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:51 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:52.486330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:52.486947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:52.493280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:52.493758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:52.494228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:52.494914 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:52.495369 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:52.495793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:52.635842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:52.638376 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:52.645485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4cb79578-f0f7-4b96-9763-f9ae1ebd496b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.163239 Sep 26 10:34:52.646068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 154/305] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:52 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:52.822553 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:52.823166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 8e2d2215-b1c9-4d65-981c-fcb3382a5b47] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:52.829144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:52.829626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:52.830108 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:52.830756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:52.831220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:52.831644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:52.845565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] HTTP exception thrown: Instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 could not be found. Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Request method failure captured: Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 HTTP/1.1 Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYAykHpVN25ejkXWzaWe7dWcGXTQo5fTQXDY-Q_j2-jIUOh3Rl6RsZ8ul_xLW678p5iUsLSrV2LjEnFGFk_2631v5BGRI6LWHDjWIYrjXOQG6yUvzp_i5sOxDd7H3t8wjIN9jUWK03YSGNhf8xrhDytsPmg4lIAbFppUML_xhtnT4CI Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: d5804df4a7c54688953727e249ce63e1 Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesActionsTest-956047227 Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:34:52.847258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5804df4a7c54688953727e249ce63e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5804df4a7c54688953727e249ce63e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5804df4a7c54688953727e249ce63e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5804df4a7c54688953727e249ce63e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesActionsTest-956047227 Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: d5804df4a7c54688953727e249ce63e1 Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesActionsTest-956047227 Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesActionsTest-956047227-project Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: d17e9dd3a1224bbcb38ab5135a918df1 Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesActionsTest-956047227-project Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 could not be found. Sep 26 10:34:52.848579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '8e2d2215-b1c9-4d65-981c-fcb3382a5b47'} Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 could not be found. Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:34:52.849393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 could not be found. Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 could not be found. Sep 26 10:34:52.851033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:52.852141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Returning 404 to user: Instance 8e2d2215-b1c9-4d65-981c-fcb3382a5b47 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:34:52.852141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2f5da465-1d24-424c-b24b-76d25761572b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47" status: 404 len: 111 microversion: 2.1 time: 0.029910 Sep 26 10:34:52.852141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 152/306] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:52 2022] GET /compute/v2.1/servers/8e2d2215-b1c9-4d65-981c-fcb3382a5b47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:34:52.952295 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-655236808", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "networks": [{"uuid": "d7be86fe-8855-4d67-93a3-d5af1e6f3acc"}]}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:53.008668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] validate_networks() for [('d7be86fe-8855-4d67-93a3-d5af1e6f3acc', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:34:53.373977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:34:53.374422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:34:53.374882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:34:53.375449 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:34:53.376220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:34:53.389028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:53.389596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:53.390365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:53.391091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:53.391677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:53.392076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:53.414075 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Getting quotas for project d5804df4a7c54688953727e249ce63e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:34:53.418685 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Getting quotas for user d17e9dd3a1224bbcb38ab5135a918df1 and project d5804df4a7c54688953727e249ce63e1. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:34:53.429921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:34:53.432239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:34:53.479280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a156aeb9-0bc8-4877-b190-8ddba47b7fe1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531115 Sep 26 10:34:53.480610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 155/307] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:34:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:34:53.493853 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-455995ce-5ffd-489d-be90-e3fab0665495 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:53.494773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-455995ce-5ffd-489d-be90-e3fab0665495 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:53.570352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-455995ce-5ffd-489d-be90-e3fab0665495 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:53.579774 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-455995ce-5ffd-489d-be90-e3fab0665495 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1213 microversion: 2.1 time: 0.091736 Sep 26 10:34:53.581007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 153/308] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:53 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:53.668289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:53.669131 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:53.675321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:53.675996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:53.676431 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:53.677691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:53.678183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:53.678610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:53.836885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:53.846890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-22ca1d8e-05b2-4fab-963f-082a08982078 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.182886 Sep 26 10:34:53.858045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 156/309] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:53 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:54.603083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:54.603669 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:54.610366 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:54.610932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:54.611437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:54.612414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:54.612849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:54.613337 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:54.678938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:54.687163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3eabbd4d-3fec-4f52-b4dd-6d7db0052a43 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1265 microversion: 2.1 time: 0.088223 Sep 26 10:34:54.688267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 154/310] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:54 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:54.872773 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:54.873396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:54.880099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:54.880601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:54.881034 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:54.881741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:54.882228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:54.882660 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.049043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:55.058624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a0347088-cbbb-4679-9730-713609044b22 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1500 microversion: 2.1 time: 0.189604 Sep 26 10:34:55.060366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 157/311] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:54 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:55.087313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "561f458c-9c0b-4825-85fd-203f4a21bdba"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:55.092361 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:55.107026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.107519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.107953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.110281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.110782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.111210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.141412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] HTTP exception thrown: Cannot 'attach_volume' instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 while it is in vm_state rescued Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Request method failure captured: Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/os-volume_attachments HTTP/1.1 Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 74 Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_QRZkIEazrHPp-ASawOGwhHKFneNncuKdrdU4jdL9mPTE68D6RIU6Tfs4pCHVzucWAe0FQlnAR5WeU26ZPDFO5PP3iYiPVIqUBsIRXPpJ6UrsXcVIuEkaZWOrJHn_jdqIiga6LqGme456-g87uXjHzgMbC3qHWSOXVyGjEtwT1DcU Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:34:55.143921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_615e5825389c4f1d96e6398bf1dab735", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 5085a918c6b74488b3dd70c1fb257381 Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {"volumeAttachment": {"volumeId": "561f458c-9c0b-4825-85fd-203f4a21bdba"}} Sep 26 10:34:55.145288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Cannot 'attach_volume' instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 while it is in vm_state rescued Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'server_id': '4c8ccb32-956e-4b12-b59b-4763a8ac14e9', 'body': {'volumeAttachment': {'volumeId': '561f458c-9c0b-4825-85fd-203f4a21bdba'}}} Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:34:55.149893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 while it is in vm_state rescued Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:34:55.151408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 while it is in vm_state rescued Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Returning 409 to user: Cannot 'attach_volume' instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 while it is in vm_state rescued {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6615f453-12de-416c-9b47-b46c9345f1fb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064338 Sep 26 10:34:55.152760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 155/312] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:34:55 2022] POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 10:34:55.154658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:55.155208 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:55.161956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.162519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.162940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.163817 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.164429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.164871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.252368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8f6d84e9-bd86-4a40-aa72-b5fc1779b82e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/action" status: 202 len: 0 microversion: 2.1 time: 0.101356 Sep 26 10:34:55.253452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 158/313] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:34:55 2022] POST /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:34:55.261840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:55.263036 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:55.271758 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.272252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.272986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.273396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.274960 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.275622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.446368 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:55.455051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-61bfc6af-7b6e-401d-8d98-1976dddc1a43 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1508 microversion: 2.1 time: 0.197377 Sep 26 10:34:55.456035 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 156/314] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:55 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:55.712772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:55.714646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:55.724046 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.724554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.725006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.725986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:55.726479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:55.730372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:55.822707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:55.831077 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6d66bd71-991e-4abb-8ba3-bd9e88d2aee9 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1265 microversion: 2.1 time: 0.122550 Sep 26 10:34:55.831665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 159/315] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:55 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:56.479270 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:56.479881 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:56.488335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:56.490531 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:56.494924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:56.496380 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:56.497622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:56.499438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:56.771356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:56.794302 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b0d8bf59-be3e-4df5-9216-bc7ccb65e7ca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1508 microversion: 2.1 time: 0.318350 Sep 26 10:34:56.795037 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 157/316] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:56 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:56.857363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:56.858005 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:56.866680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:56.867390 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:56.867982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:56.868876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:56.869515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:56.870109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:56.970684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:56.990605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-12dbe5ff-03aa-4a4c-8f17-744d595359d7 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1271 microversion: 2.1 time: 0.138709 Sep 26 10:34:56.991909 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 160/317] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:56 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:57.285907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0fdb2332-76f5-40b4-ad28-338efb770883 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:57.298713 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0fdb2332-76f5-40b4-ad28-338efb770883 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:57.299500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0fdb2332-76f5-40b4-ad28-338efb770883 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:57.300252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0fdb2332-76f5-40b4-ad28-338efb770883 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:57.390477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0fdb2332-76f5-40b4-ad28-338efb770883 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Going to try to stop instance {{(pid=127055) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 10:34:57.462689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0fdb2332-76f5-40b4-ad28-338efb770883 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action" status: 202 len: 0 microversion: 2.1 time: 0.181388 Sep 26 10:34:57.463314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 158/318] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:34:57 2022] POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:34:57.472119 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:57.473327 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:57.480341 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:57.481832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:57.482506 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:57.483587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:57.484263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:57.485222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:57.671442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:57.681862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0026c44a-c850-46ce-93cf-2b6d759cecd2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.213668 Sep 26 10:34:57.698230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 161/319] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:57 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:57.819011 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:57.819718 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:57.826761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:57.827250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:57.827679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:57.828572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:57.829016 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:57.829608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:57.846167 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:34:57.985667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:57.993375 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-48b79cd3-bd0e-4a14-b07a-4a070407f9a4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1508 microversion: 2.1 time: 0.178672 Sep 26 10:34:57.993943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 159/320] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:57 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:58.017198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:58.017808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:58.024602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:58.025388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:58.025820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:58.026835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:58.027380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:58.028056 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:58.162089 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:58.170339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9a98379f-7e5a-4d0a-84ca-7ecda1cbd1cb tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.156904 Sep 26 10:34:58.171281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 162/321] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:58 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:58.704829 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:58.705922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:58.712843 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:58.713712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:58.714403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:58.715943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:58.716654 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:58.717295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:59.017153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:59.018181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:59.025459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:59.026372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:59.026985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:59.028476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:59.029260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:59.029891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:59.323594 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:59.344946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b998df19-65da-4dba-aaa1-79f76d6824d3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.643866 Sep 26 10:34:59.350183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 160/322] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:58 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:59.355540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:34:59.356265 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:34:59.363667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:59.364304 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:59.364836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:59.365655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:59.366402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:59.366977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:59.388578 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:59.398069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-745c7162-dd3e-4e68-9a46-e6a311a009bb tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1514 microversion: 2.1 time: 0.384929 Sep 26 10:34:59.413757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 163/323] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:59 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:34:59.609901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:34:59.625310 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7f63b396-f4a7-4d6e-8ad6-6ffbf2afb733 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.273423 Sep 26 10:34:59.625926 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 161/324] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:34:59 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:34:59.823013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-04055fa7-289f-4ffc-a3d7-7db45ae8f5b1 req-8c5f9ff9-310a-4ca0-87fd-42901e56f1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608bdad4-bd12-460a-b753-9fba03102268", "tag": "3385e933-4ba4-48d0-be79-5356e23bc72f"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:34:59.836892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-04055fa7-289f-4ffc-a3d7-7db45ae8f5b1 req-8c5f9ff9-310a-4ca0-87fd-42901e56f1bb service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:34:59.837379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-04055fa7-289f-4ffc-a3d7-7db45ae8f5b1 req-8c5f9ff9-310a-4ca0-87fd-42901e56f1bb service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:34:59.837814 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-04055fa7-289f-4ffc-a3d7-7db45ae8f5b1 req-8c5f9ff9-310a-4ca0-87fd-42901e56f1bb service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:34:59.867589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-04055fa7-289f-4ffc-a3d7-7db45ae8f5b1 req-8c5f9ff9-310a-4ca0-87fd-42901e56f1bb service nova] Creating event network-changed:3385e933-4ba4-48d0-be79-5356e23bc72f for instance 608bdad4-bd12-460a-b753-9fba03102268 on hv-cinder-84456 Sep 26 10:34:59.880719 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-04055fa7-289f-4ffc-a3d7-7db45ae8f5b1 req-8c5f9ff9-310a-4ca0-87fd-42901e56f1bb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080220 Sep 26 10:34:59.881858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 164/325] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:35:00.373314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:00.374725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:00.381240 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:00.382147 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:00.382762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:00.383471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:00.383921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:00.384339 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:00.623477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:00.634716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c36e0141-848d-43e2-8213-6c64e77545f3 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.265728 Sep 26 10:35:00.635691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 162/326] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:00 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:00.653953 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:00.654783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:00.662957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:00.663547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:00.664060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:00.664841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:00.665392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:00.666101 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:00.880508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:00.891993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f82e0225-1ee0-4c43-95bf-8bc711de4438 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.242359 Sep 26 10:35:00.892569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f606f241-34f3-45b1-8d03-52e9a874de78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'create', calling method: .version_select at 0x7fbadb37dc10>, body: {"keypair": {"name": "tempest-keypair-1442016636", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5+Qy9fNjjW0OAFx26JRvDYDoa9fMZChJAuyCh+uh24KV6/cFEo3sV3kNCxjCm8w6Vn2ekUG0yFBgiouXDBCbg3qSsjECTOlK9nkz9rkipQcHVrY1OdarcefvcSfsOBGA=="}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:00.893535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 165/327] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:00 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:00.914745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-f606f241-34f3-45b1-8d03-52e9a874de78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for project 615e5825389c4f1d96e6398bf1dab735. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:35:00.919603 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-f606f241-34f3-45b1-8d03-52e9a874de78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for user 5085a918c6b74488b3dd70c1fb257381 and project 615e5825389c4f1d96e6398bf1dab735. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:35:00.946168 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f606f241-34f3-45b1-8d03-52e9a874de78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057826 Sep 26 10:35:00.946766 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 163/328] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:35:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:01.660736 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:01.661794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:01.672060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:01.675953 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:01.676453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:01.677201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:01.678569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:01.679570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:01.921435 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:01.922548 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:01.933574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:01.937170 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:01.937634 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:01.938432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:01.938903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:01.939331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:02.141649 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:02.160190 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cb7d34d3-dda9-45a3-850e-31252fc2b2c0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.503249 Sep 26 10:35:02.160784 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 166/329] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:01 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:02.475189 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:02.488077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-43e1e0f1-8c5e-47c5-bae3-a74c5690a99d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.569066 Sep 26 10:35:02.489003 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 164/330] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:01 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:02.832071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1121533604", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0c42b441-b7cf-4fd0-9783-6f8c9cc37e1c"}], "security_groups": [{"name": "tempest-securitygroup--373350117"}], "key_name": "tempest-keypair-1442016636", "user_data": "}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:02.856641 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:03.189882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:03.190540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:03.203873 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:03.204685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:03.205755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:03.207229 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] validate_networks() for [('0c42b441-b7cf-4fd0-9783-6f8c9cc37e1c', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:35:03.207907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:03.209096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:03.209733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:03.402746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:03.426659 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=6 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:03.897764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:03.908731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5bb6d1af-494c-4fd6-982a-eaf28bc6a816 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.723964 Sep 26 10:35:03.920597 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 165/331] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:03 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:03.928538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:03.932450 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:03.944788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:03.945352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:03.945878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:03.946679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:03.947221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:03.947713 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:04.340478 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:04.348936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-80f52bad-06be-4448-b5af-504ef63a17de tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.436681 Sep 26 10:35:04.349690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 166/332] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:03 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:04.354867 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7496b44c-57ee-4190-b649-6be3bc23336e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: .version_select at 0x7fbadb64a4c0>, body: {"keypair": {"name": "tempest-keypair-940098667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCE0L11JZFZOK91y7RBrezAeYyVIeyZ8k0mMvqqiXoZf6kJGm0RN9YWUF2k34OJH10JXiZgW4BN4Dmt+UHTTobAiDyMVBePJY/aoO3jYhPOXzZMkVKyrLP2DDvXRvdlSPg=="}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:04.373636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-7496b44c-57ee-4190-b649-6be3bc23336e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:35:04.378579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-7496b44c-57ee-4190-b649-6be3bc23336e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:35:04.403156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7496b44c-57ee-4190-b649-6be3bc23336e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051652 Sep 26 10:35:04.403751 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 167/333] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:35:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:04.564605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:35:04.565143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:35:04.565475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:35:04.565875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:35:04.566599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:35:04.581498 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:04.582605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:04.583786 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:04.586307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:04.587074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:04.587598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:04.613020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for project 615e5825389c4f1d96e6398bf1dab735. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:35:04.619154 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Getting quotas for user 5085a918c6b74488b3dd70c1fb257381 and project 615e5825389c4f1d96e6398bf1dab735. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:35:04.635184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:35:04.639049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:35:04.722789 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8866d91d-cd5d-41f9-a5a0-c460a05f0240 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.896127 Sep 26 10:35:04.737796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f0d4e656-126c-4783-a52e-2268f5a7a431 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:04.738927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f0d4e656-126c-4783-a52e-2268f5a7a431 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:04.745607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 167/334] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:35:02 2022] POST /compute/v2.1/servers => generated 408 bytes in 1916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:35:04.837661 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f0d4e656-126c-4783-a52e-2268f5a7a431 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:04.846987 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f0d4e656-126c-4783-a52e-2268f5a7a431 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1246 microversion: 2.1 time: 0.113027 Sep 26 10:35:04.849254 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 168/335] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:04 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:04.938691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:04.941259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:04.958628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:04.959040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:04.959482 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:04.960183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:04.960639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:04.961063 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:05.240984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:05.249194 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-304533e4-11dc-4924-823d-b020246b0b8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.315632 Sep 26 10:35:05.256436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 168/336] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:04 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:05.377102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:05.378619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:05.387602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:05.388445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:05.389111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:05.390015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:05.390693 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:05.391493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:05.639590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:05.651303 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ef833011-ea6b-4eda-a238-a1c6ebff24fc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.278102 Sep 26 10:35:05.656502 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 169/337] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:05 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:05.881554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:05.883125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:05.901562 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:05.902405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:05.903439 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:05.904487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:05.905100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:05.905725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:06.099802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-490523469", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bfae35e-29c7-4379-ac17-c54030a00cba"}], "security_groups": [{"name": "tempest-securitygroup--1226196991"}], "key_name": "tempest-keypair-940098667", "user_data": "}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:06.268280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:06.281010 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1b84a801-2bad-4c4e-a2b6-6ad1fb5319a1 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1298 microversion: 2.1 time: 0.412008 Sep 26 10:35:06.281791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 169/338] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:05 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1298 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:06.292895 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:06.294153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:06.311401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:06.312671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:06.313386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:06.315079 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:06.316254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:06.317647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:06.418961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] validate_networks() for [('5bfae35e-29c7-4379-ac17-c54030a00cba', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:35:06.760263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:06.770128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ec20658d-414b-4844-8139-d750c38dac33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.487256 Sep 26 10:35:06.791122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 170/339] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:06 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:06.810307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-2f7b7d2e-f062-4b59-adfb-1ae227603891 req-cb199d62-d259-4ae0-a2df-74afa1e9ac25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608bdad4-bd12-460a-b753-9fba03102268", "name": "network-vif-plugged", "status": "completed", "tag": "3385e933-4ba4-48d0-be79-5356e23bc72f"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:06.820600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2f7b7d2e-f062-4b59-adfb-1ae227603891 req-cb199d62-d259-4ae0-a2df-74afa1e9ac25 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:06.821826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2f7b7d2e-f062-4b59-adfb-1ae227603891 req-cb199d62-d259-4ae0-a2df-74afa1e9ac25 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:06.822440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2f7b7d2e-f062-4b59-adfb-1ae227603891 req-cb199d62-d259-4ae0-a2df-74afa1e9ac25 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:06.836539 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-2f7b7d2e-f062-4b59-adfb-1ae227603891 req-cb199d62-d259-4ae0-a2df-74afa1e9ac25 service nova] Creating event network-vif-plugged:3385e933-4ba4-48d0-be79-5356e23bc72f for instance 608bdad4-bd12-460a-b753-9fba03102268 on hv-cinder-84456 Sep 26 10:35:06.842898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-2f7b7d2e-f062-4b59-adfb-1ae227603891 req-cb199d62-d259-4ae0-a2df-74afa1e9ac25 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050229 Sep 26 10:35:06.844397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 171/340] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:06.849891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:06.851132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:06.860878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:06.861691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:06.862313 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:06.863180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:06.863804 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:06.864392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.370358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:07.379974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ca0ea795-f33b-4c3e-b2e3-e05d466bce29 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.533968 Sep 26 10:35:07.390054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 172/341] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:06 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:07.390054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:07.390054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:07.392742 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:07.393777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:07.394741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.396112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:07.397067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:07.397716 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.403553 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:07.532201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:07.544955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3bd2cd46-9b3c-4fd2-9d1b-e3ebed04ab09 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1304 microversion: 2.1 time: 0.162876 Sep 26 10:35:07.545480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 173/342] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:07 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:07.643682 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:35:07.644174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:35:07.644545 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:35:07.645246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:35:07.645664 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:35:07.661686 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:07.662445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:07.663049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.664016 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:07.664616 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:07.665187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.688985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:35:07.693248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:35:07.705773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:35:07.708329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:35:07.726419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:07.780501 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-830191e1-ddad-4de8-981d-34add61d8795 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.685619 Sep 26 10:35:07.788833 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 170/343] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:35:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 10:35:07.795437 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8edf5878-0698-428a-8da4-b7bedfc7dfc4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:07.796189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8edf5878-0698-428a-8da4-b7bedfc7dfc4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:07.802901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:07.803830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:07.812538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:07.813246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:07.813849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.814822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:07.816498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:07.817341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:07.969839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8edf5878-0698-428a-8da4-b7bedfc7dfc4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:07.978196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8edf5878-0698-428a-8da4-b7bedfc7dfc4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1240 microversion: 2.1 time: 0.188734 Sep 26 10:35:07.978967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 174/344] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:07 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1240 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:08.147443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:08.156756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-90b0d964-7c8e-4626-b8fa-9a5fad8fe521 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.361304 Sep 26 10:35:08.170046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 171/345] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:07 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:08.405690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:08.406586 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:08.414185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:08.414838 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:08.415621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:08.416476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:08.417037 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:08.417567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:08.572419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:08.573178 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:08.581074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:08.581683 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:08.582226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:08.583200 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:08.583741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:08.584235 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:08.999284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:09.007437 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ad20d287-13e5-49c7-824e-b67ec8001809 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1313 microversion: 2.1 time: 0.606527 Sep 26 10:35:09.008010 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 175/346] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:08 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:09.013454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:09.014282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:09.020931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:09.021759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:09.022456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:09.023520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:09.024136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:09.024767 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:09.092587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:09.101351 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c5573e9e-b497-4353-9b7d-1b3583c77dca tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.533309 Sep 26 10:35:09.101930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 172/347] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:08 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:09.148144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:09.156519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2964fbbc-ab9f-4334-87c3-025ecd3f478a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1292 microversion: 2.1 time: 0.147312 Sep 26 10:35:09.157027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 176/348] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:09 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1292 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:09.180944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:09.181563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:09.188227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:09.188868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:09.189403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:09.190308 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:09.190867 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:09.191595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:09.481579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:09.514253 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-98501e1a-ac2d-4c2d-af7b-c1683b4b60a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.323412 Sep 26 10:35:09.515385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 173/349] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:09 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:10.033180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:10.033794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:10.045428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.050775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.051432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.052436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.053111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.053892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.126288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:10.126914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:10.136783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.137854 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.138623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.139433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.139841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.142303 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.502936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:10.508193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:10.511520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-02a5c678-e71c-4082-9c9c-5c66dfc6b493 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1496 microversion: 2.1 time: 0.481907 Sep 26 10:35:10.529489 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 177/350] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:10 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1496 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:10.532202 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5a772358-0789-41d0-b36b-a79034ac296d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.409897 Sep 26 10:35:10.533931 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 174/351] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:10 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:10.539291 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:10.540552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-64217402-1bf8-4740-a9dd-154a26935498 req-0156c36b-657d-47a8-9b10-f8baf0b7a1fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c4900f-d778-4d9f-98f5-2657ff241a0e", "tag": "852a1cf1-997f-48f3-ba24-fee4c258bd27"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:10.541085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:10.550744 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-64217402-1bf8-4740-a9dd-154a26935498 req-0156c36b-657d-47a8-9b10-f8baf0b7a1fc service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.552041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-64217402-1bf8-4740-a9dd-154a26935498 req-0156c36b-657d-47a8-9b10-f8baf0b7a1fc service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.552682 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-64217402-1bf8-4740-a9dd-154a26935498 req-0156c36b-657d-47a8-9b10-f8baf0b7a1fc service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.556229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.557041 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.559520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.561460 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.562160 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.564332 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.572817 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-64217402-1bf8-4740-a9dd-154a26935498 req-0156c36b-657d-47a8-9b10-f8baf0b7a1fc service nova] Creating event network-changed:852a1cf1-997f-48f3-ba24-fee4c258bd27 for instance 31c4900f-d778-4d9f-98f5-2657ff241a0e on hv-cinder-84456 Sep 26 10:35:10.578733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-64217402-1bf8-4740-a9dd-154a26935498 req-0156c36b-657d-47a8-9b10-f8baf0b7a1fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047601 Sep 26 10:35:10.581494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 178/352] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:10.587309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:10.588262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:10.596653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.597354 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.597948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.598923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:10.599658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:10.600274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:10.740770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:10.751972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c19d334f-0d54-41c2-959f-daee5dc9c78c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1298 microversion: 2.1 time: 0.216445 Sep 26 10:35:10.753584 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 175/353] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:10 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1298 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:11.014717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:11.062913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c9accbc8-1ee5-4d90-b6b2-200725d9fbf6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.479873 Sep 26 10:35:11.064789 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 179/354] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:10 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:11.400515 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:11.401944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:11.412102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.413446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.414121 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.415091 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.415742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.416826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.487614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:35:11.567053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:11.567738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:11.592090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.592928 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.594698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.595620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.597444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.600443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.663565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5aad5d6f-4761-42da-88fb-049a089dd053 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "DELETE /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 204 len: 0 microversion: 2.1 time: 0.266388 Sep 26 10:35:11.664830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 176/355] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:35:11 2022] DELETE /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:35:11.691136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:11.693308 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:11.722805 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.723224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.723658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.724366 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.724807 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.735169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.901901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:11.917849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-413dae70-739d-4651-860f-de4c2be4a5ad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.360493 Sep 26 10:35:11.926804 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 180/356] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:11 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:11.949754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:11.950407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:11.959193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.967829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.968617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:11.970273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:11.970936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:11.983562 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:12.283618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:12.291776 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-416e8b6b-41f1-45c2-b2e1-fb7ca4035d67 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.363616 Sep 26 10:35:12.295813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 181/357] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:11 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:12.301871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:12.306038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:12.318467 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:12.331892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:12.332402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:12.332842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:12.333551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:12.334009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:12.334467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:12.339208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e28ca661-6e5f-49c3-a2b9-d6bce636fb2d tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1502 microversion: 2.1 time: 0.659060 Sep 26 10:35:12.351104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 177/358] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:11 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1502 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:12.496250 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:12.510160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9d4d32e4-fe26-4027-a546-1bc1c0f24114 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.208272 Sep 26 10:35:12.511516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 182/359] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:12 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:12.583922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-06307fd7-7ffa-430e-ac17-1a819e83a7bd req-7f2aa3b1-8ef0-449f-ac70-40c48cd617ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c49866e-9fb8-4d0f-8e65-4cf8d565895d", "tag": "853197ed-c11a-4040-abb1-0d954ce1ae71"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:12.601367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-06307fd7-7ffa-430e-ac17-1a819e83a7bd req-7f2aa3b1-8ef0-449f-ac70-40c48cd617ae service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:12.606499 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-06307fd7-7ffa-430e-ac17-1a819e83a7bd req-7f2aa3b1-8ef0-449f-ac70-40c48cd617ae service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:12.607205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-06307fd7-7ffa-430e-ac17-1a819e83a7bd req-7f2aa3b1-8ef0-449f-ac70-40c48cd617ae service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:12.611865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:12.629343 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-06307fd7-7ffa-430e-ac17-1a819e83a7bd req-7f2aa3b1-8ef0-449f-ac70-40c48cd617ae service nova] Creating event network-changed:853197ed-c11a-4040-abb1-0d954ce1ae71 for instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d on hv-cinder-84456 Sep 26 10:35:12.640320 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-06307fd7-7ffa-430e-ac17-1a819e83a7bd req-7f2aa3b1-8ef0-449f-ac70-40c48cd617ae service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059906 Sep 26 10:35:12.641515 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 178/360] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:12.951633 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:12.952599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:12.959715 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:12.960204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:12.960642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:12.961495 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:12.961951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:12.962399 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.110002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:13.119840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5c14a6c5-16cb-47be-9225-50b596ce8c60 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.174531 Sep 26 10:35:13.130099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 183/361] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:12 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:13.323088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:13.323983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:13.332047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:13.332047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:13.332453 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.333183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:13.333561 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:13.334159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.366154 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:13.366915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:13.373380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:13.373939 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:13.374500 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.389110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:13.390123 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:13.390797 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.520020 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:13.531309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f2f782db-6e77-482c-82bb-bcb703598b7c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.211726 Sep 26 10:35:13.532077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 179/362] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:13 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:13.555574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:13.556313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:13.564017 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:13.566162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:13.566823 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.568117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:13.568117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:13.568617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:13.607434 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:13.617548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-33f9e8e6-1244-46ce-b740-5b18a95c57e1 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1502 microversion: 2.1 time: 0.256444 Sep 26 10:35:13.630054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 184/363] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:13 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:13.727963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:13.747116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5d3a3187-f66b-4849-929e-0e1050107128 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.194777 Sep 26 10:35:13.748534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 180/364] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:13 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:14.146560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:14.147112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:14.156519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:14.168012 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:14.173715 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:14.174756 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:14.178943 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:14.181910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:14.438629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:14.452763 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-42843bc8-bcd6-434f-8549-79505fcb77de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.308325 Sep 26 10:35:14.470679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 185/365] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:14 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:14.555763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:14.558210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:14.568940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:14.569895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:14.571705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:14.572679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:14.573364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:14.574608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:14.646714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:14.647329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:14.649293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:14.655494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:14.655983 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:14.656425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:14.657199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:14.657652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:14.658108 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:14.981111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:14.989845 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c47eec5e-beb7-4590-97ed-505f96958cf3 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.439821 Sep 26 10:35:14.991029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 181/366] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:14 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:14.997619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:14.997850 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:15.007404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:15.007746 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:15.008188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:15.008915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:15.009372 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:15.010226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:15.088169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:15.100809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-589f13b9-e942-41c7-8e48-837b4220390b tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1502 microversion: 2.1 time: 0.457598 Sep 26 10:35:15.101542 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 186/367] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:14 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1502 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:15.242999 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:15.253606 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-07bfd36c-4aaf-4d7a-aba3-cb7036c47b73 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.261298 Sep 26 10:35:15.271822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 182/368] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:14 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:15.343379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-b3232204-23a8-4e50-9696-aa75a4a2eb17 req-26a4f5b7-9d2b-4453-b2ef-9ea0d257b29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608bdad4-bd12-460a-b753-9fba03102268", "name": "network-vif-deleted", "tag": "3385e933-4ba4-48d0-be79-5356e23bc72f"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:15.354363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b3232204-23a8-4e50-9696-aa75a4a2eb17 req-26a4f5b7-9d2b-4453-b2ef-9ea0d257b29e service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:15.355082 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b3232204-23a8-4e50-9696-aa75a4a2eb17 req-26a4f5b7-9d2b-4453-b2ef-9ea0d257b29e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:15.355734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b3232204-23a8-4e50-9696-aa75a4a2eb17 req-26a4f5b7-9d2b-4453-b2ef-9ea0d257b29e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:15.367315 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-b3232204-23a8-4e50-9696-aa75a4a2eb17 req-26a4f5b7-9d2b-4453-b2ef-9ea0d257b29e service nova] Creating event network-vif-deleted:3385e933-4ba4-48d0-be79-5356e23bc72f for instance 608bdad4-bd12-460a-b753-9fba03102268 on hv-cinder-84456 Sep 26 10:35:15.373304 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-b3232204-23a8-4e50-9696-aa75a4a2eb17 req-26a4f5b7-9d2b-4453-b2ef-9ea0d257b29e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034248 Sep 26 10:35:15.374075 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 187/369] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:35:15.476896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:15.477510 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:15.486657 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:15.487078 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:15.487516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:15.488217 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:15.488672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:15.489092 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:15.646460 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:15.657707 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e277b8a3-84da-423a-ac22-37a480194074 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.185347 Sep 26 10:35:15.658404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 183/370] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:15 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:16.013878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:16.015867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:16.026092 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.026652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.027096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.027842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.028309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.028734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.131676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:16.133137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:16.141750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.145667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.148422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.150622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.151982 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.152709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.212557 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.214255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.215866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.216652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lazy-loading 'fault' on Instance uuid 608bdad4-bd12-460a-b753-9fba03102268 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:35:16.294889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17e9dd3a1224bbcb38ab5135a918df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5804df4a7c54688953727e249ce63e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:16.308700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-555507dc-4393-41c2-b0a9-2e96292be421 tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 200 len: 1303 microversion: 2.1 time: 0.178781 Sep 26 10:35:16.328138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 184/371] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:16 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 1303 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:16.342776 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:16.345409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:16.352318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.353206 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.353857 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.354822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.355055 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:16.360189 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.360934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.369266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2b1a2da2-a774-4c88-9a04-f95d3fe2c8ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.360162 Sep 26 10:35:16.395232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 188/372] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:16 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:16.531712 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-76478b65-854a-4880-8822-1b1e726f2475 req-72d2e188-f816-45b2-b33e-7d2df65af1de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c4900f-d778-4d9f-98f5-2657ff241a0e", "name": "network-vif-plugged", "status": "completed", "tag": "852a1cf1-997f-48f3-ba24-fee4c258bd27"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:16.549062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-76478b65-854a-4880-8822-1b1e726f2475 req-72d2e188-f816-45b2-b33e-7d2df65af1de service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.551070 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-76478b65-854a-4880-8822-1b1e726f2475 req-72d2e188-f816-45b2-b33e-7d2df65af1de service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.551796 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-76478b65-854a-4880-8822-1b1e726f2475 req-72d2e188-f816-45b2-b33e-7d2df65af1de service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.568165 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-76478b65-854a-4880-8822-1b1e726f2475 req-72d2e188-f816-45b2-b33e-7d2df65af1de service nova] Creating event network-vif-plugged:852a1cf1-997f-48f3-ba24-fee4c258bd27 for instance 31c4900f-d778-4d9f-98f5-2657ff241a0e on hv-cinder-84456 Sep 26 10:35:16.585099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-76478b65-854a-4880-8822-1b1e726f2475 req-72d2e188-f816-45b2-b33e-7d2df65af1de service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059157 Sep 26 10:35:16.588426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 189/373] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:35:16.593135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:16.606771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d7f49a94-88ab-47cc-95a0-14e32d1d5abc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.273131 Sep 26 10:35:16.608004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 185/374] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:16 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:16.681251 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:16.682170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:16.690410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.691239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.691917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.692991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:16.693803 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:16.694487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:16.838728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:16.847115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7606c55b-21e5-4fc6-b8e4-b2dc207bb3ab tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.169983 Sep 26 10:35:16.847925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 190/375] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:16 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:17.339686 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:17.341080 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] [instance: 608bdad4-bd12-460a-b753-9fba03102268] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:17.347292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.347847 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.348279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.349001 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.349447 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.349859 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.367268 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] HTTP exception thrown: Instance 608bdad4-bd12-460a-b753-9fba03102268 could not be found. Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Request method failure captured: Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 HTTP/1.1 Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYAykHpVN25ejkXWzaWe7dWcGXTQo5fTQXDY-Q_j2-jIUOh3Rl6RsZ8ul_xLW678p5iUsLSrV2LjEnFGFk_2631v5BGRI6LWHDjWIYrjXOQG6yUvzp_i5sOxDd7H3t8wjIN9jUWK03YSGNhf8xrhDytsPmg4lIAbFppUML_xhtnT4CI Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: d5804df4a7c54688953727e249ce63e1 Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesActionsTest-956047227 Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:35:17.368915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/d5804df4a7c54688953727e249ce63e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_d5804df4a7c54688953727e249ce63e1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5804df4a7c54688953727e249ce63e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/d5804df4a7c54688953727e249ce63e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesActionsTest-956047227 Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: d5804df4a7c54688953727e249ce63e1 Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesActionsTest-956047227 Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesActionsTest-956047227-project Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: d17e9dd3a1224bbcb38ab5135a918df1 Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesActionsTest-956047227-project Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 608bdad4-bd12-460a-b753-9fba03102268 could not be found. Sep 26 10:35:17.370241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '608bdad4-bd12-460a-b753-9fba03102268'} Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608bdad4-bd12-460a-b753-9fba03102268 could not be found. Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:35:17.370962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608bdad4-bd12-460a-b753-9fba03102268 could not be found. Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608bdad4-bd12-460a-b753-9fba03102268 could not be found. Sep 26 10:35:17.372808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:35:17.375479 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] Returning 404 to user: Instance 608bdad4-bd12-460a-b753-9fba03102268 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:35:17.375479 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-23faf408-bbd5-4c39-ade3-a2b89391f7bc tempest-VolumesActionsTest-956047227 tempest-VolumesActionsTest-956047227-project] 10.222.0.49 "GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268" status: 404 len: 111 microversion: 2.1 time: 0.034914 Sep 26 10:35:17.385957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 186/376] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:17 2022] GET /compute/v2.1/servers/608bdad4-bd12-460a-b753-9fba03102268 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:35:17.403673 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:17.404466 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:17.416244 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.419610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.420204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.421169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.421785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.422436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.625132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:17.636849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-05f88fd2-c8db-4bfd-9044-2904c425ef94 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.243351 Sep 26 10:35:17.650055 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 191/377] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:17 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:17.650664 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:17.650664 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:17.654000 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.654527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.661606 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.662694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.663184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.663629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.676106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:17.701159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=18 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:17.854593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:17.881278 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:17.881414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:17.896938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8354cef0-ec95-40b7-a074-a01478b7bbe0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.257681 Sep 26 10:35:17.897645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.898176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.899038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.899886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:17.900223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:17.900823 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 187/378] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:17 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:17.901501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:17.974768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=8 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:18.092725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:18.099718 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:18.112552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9803b5ca-f5f8-4238-8761-13feb9615bf5 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.236175 Sep 26 10:35:18.113455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 192/379] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:17 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:18.663110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:18.664405 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:18.671392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:18.672124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:18.672555 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:18.673414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:18.674056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:18.674475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:18.835205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:18.844191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1be73e3f-911e-4a1f-bf2e-19f23454bfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.185048 Sep 26 10:35:18.858154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 188/380] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:18 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:18.928362 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:18.929134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:18.936195 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:18.936972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:18.937646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:18.938475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:18.940846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:18.941376 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:19.087335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:19.095974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d7c4e767-9821-421c-ac5d-9c90b9bba988 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.171679 Sep 26 10:35:19.096680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 193/381] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:18 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:19.151192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:19.152097 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:19.158741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:19.159451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:19.160075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:19.160773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:19.161265 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:19.161677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:19.301151 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:19.311874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-48d8ccb8-af1f-458f-a295-4726d4f8a51a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.165231 Sep 26 10:35:19.312825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 189/382] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:19 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:19.867055 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:19.868148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:19.874512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:19.875656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:19.876114 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:19.877600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:19.878089 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:19.878545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:20.123195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:20.124948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:20.131626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:20.132500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:20.135593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:20.136676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:20.137893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:20.138576 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:20.300026 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:20.309900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7919a904-80b2-4463-8c00-95229a115f3e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.446429 Sep 26 10:35:20.311494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 194/383] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:19 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:20.336630 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:20.337628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:20.348040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:20.348920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:20.349616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:20.350579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:20.351513 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:20.352298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:20.359349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:20.368229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-94763b81-45aa-43ee-8972-cabfd86d9862 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.250148 Sep 26 10:35:20.369120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 190/384] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:20 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:20.507614 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:20.518206 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-29616a62-1693-40f6-919b-22774d573448 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.185611 Sep 26 10:35:20.530045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 195/385] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:20 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:21.335999 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:21.336966 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:21.345828 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:21.347965 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:21.348406 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:21.349108 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:21.349567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:21.349987 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:21.394135 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:21.406938 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:21.424528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:21.425599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:21.426290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:21.427225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:21.427891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:21.428527 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:21.515710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:21.524695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-857e5da1-d74c-42ca-8916-239fea1cc886 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.194121 Sep 26 10:35:21.538768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 191/386] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:21 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:21.545489 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:21.545489 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:21.552474 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:21.555222 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:21.555665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:21.557188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:21.557936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:21.560251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:21.737977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:21.748043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5ceee425-0b00-4dca-8f6c-6849b31bd8b7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1724 microversion: 2.1 time: 0.358481 Sep 26 10:35:21.748802 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 196/387] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:21 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:21.771560 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:21.783811 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e6ffdee0-da19-4997-8172-fce4545e3fe4 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1371 microversion: 2.1 time: 0.246166 Sep 26 10:35:21.784722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 192/388] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:21 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:21.942536 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7c7ce66c-833f-43c2-ae2d-3032028e7fc9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Action: 'create', calling method: .version_select at 0x7fbadb31ef70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1337346705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIW2/dvaDyuRM5cjdvoMDd2PSMB+i2sn2hkmNwhR1icr6wQYMkM/I8dnHVpkso9BkuAuf+uu5KGTcRFz/HfyGn6zAlakLm00A0FzdgVUSvQBQgAX64sLUuebI36iY84/TQ=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:21.957969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-7c7ce66c-833f-43c2-ae2d-3032028e7fc9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Getting quotas for project 6bb20c7af7544a06adaa9b5e47b03cd1. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:35:21.961753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-7c7ce66c-833f-43c2-ae2d-3032028e7fc9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Getting quotas for user 681edd9335a644a69a497a5c528920a8 and project 6bb20c7af7544a06adaa9b5e47b03cd1. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:35:21.984039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7c7ce66c-833f-43c2-ae2d-3032028e7fc9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045444 Sep 26 10:35:21.984628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 197/389] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:35:21 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:22.092907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2010803852", "imageRef": "66c21174-d18a-4af5-8660-8b900cad16fa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1337346705", "networks": [{"uuid": "55d4234f-5ea7-4f10-8611-3be0546101de"}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:22.145636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] validate_networks() for [('55d4234f-5ea7-4f10-8611-3be0546101de', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:35:22.522309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:35:22.523101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:35:22.523769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:35:22.524337 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:35:22.525202 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:35:22.535911 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.536628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.537190 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.537923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.538419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.538908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.553124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:22.553738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:22.556322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Getting quotas for project 6bb20c7af7544a06adaa9b5e47b03cd1. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:35:22.561101 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.561249 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Getting quotas for user 681edd9335a644a69a497a5c528920a8 and project 6bb20c7af7544a06adaa9b5e47b03cd1. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:35:22.561794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.562225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.563009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.563637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.563956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.574608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:35:22.577593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='66c21174-d18a-4af5-8660-8b900cad16fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:35:22.628925 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-aa5320f8-e2ea-4b70-bf55-df4d3b4a9e4f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539887 Sep 26 10:35:22.642297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 193/390] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:35:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:35:22.648037 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-95c6b150-09ad-42f9-a5b5-24c309613807 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:22.648955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-95c6b150-09ad-42f9-a5b5-24c309613807 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:22.734432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-95c6b150-09ad-42f9-a5b5-24c309613807 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:22.746712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-95c6b150-09ad-42f9-a5b5-24c309613807 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1259 microversion: 2.1 time: 0.102429 Sep 26 10:35:22.751884 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:22.763096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 194/391] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:22 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1259 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:22.764521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c92528d4-bc36-4b35-b60a-9d85c0b0f3b6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.215453 Sep 26 10:35:22.765322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 198/392] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:22 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:22.787054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:22.788509 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:22.810447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:22.811144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:22.811535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.812201 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.812651 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.813368 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.813822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.814297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.820961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.821541 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.822677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:22.824066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:22.825170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:22.825821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.071118 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:23.082770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-65d27d3e-e993-46b9-811b-e82e16e34d66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1701 microversion: 2.1 time: 0.311682 Sep 26 10:35:23.098163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 195/393] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:22 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1701 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:23.108050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d9a68668-5930-45e7-95c1-b9b1357444df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:23.115354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9a68668-5930-45e7-95c1-b9b1357444df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.115936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9a68668-5930-45e7-95c1-b9b1357444df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.116458 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9a68668-5930-45e7-95c1-b9b1357444df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.121936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:23.131822 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a0385941-822b-48e3-960e-a665b8410d66 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1565 microversion: 2.1 time: 0.325654 Sep 26 10:35:23.147132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 199/394] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:22 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1565 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:23.153505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d9a68668-5930-45e7-95c1-b9b1357444df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Going to try to start instance {{(pid=127055) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 10:35:23.160721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:23.161446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:23.169099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.169728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.170440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.171292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.171847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.172369 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.198714 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:23.226539 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d9a68668-5930-45e7-95c1-b9b1357444df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action" status: 202 len: 0 microversion: 2.1 time: 0.121800 Sep 26 10:35:23.227557 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 196/395] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:35:23 2022] POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 10:35:23.251730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:23.252607 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:23.263224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.263224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.263518 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.264358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.265550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.266104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.296743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c2b88853-0b07-41cb-80df-0ae7abc0b439 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141228 Sep 26 10:35:23.304006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 200/396] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:35:23 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:23.700847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-2dfc4317-8149-4822-8925-3291d38af505 req-dd585a9c-6100-4459-bd39-4dcbee3d9572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c49866e-9fb8-4d0f-8e65-4cf8d565895d", "name": "network-vif-plugged", "status": "completed", "tag": "853197ed-c11a-4040-abb1-0d954ce1ae71"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:23.742497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2dfc4317-8149-4822-8925-3291d38af505 req-dd585a9c-6100-4459-bd39-4dcbee3d9572 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.744198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2dfc4317-8149-4822-8925-3291d38af505 req-dd585a9c-6100-4459-bd39-4dcbee3d9572 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.745081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2dfc4317-8149-4822-8925-3291d38af505 req-dd585a9c-6100-4459-bd39-4dcbee3d9572 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.766405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-2dfc4317-8149-4822-8925-3291d38af505 req-dd585a9c-6100-4459-bd39-4dcbee3d9572 service nova] Creating event network-vif-plugged:853197ed-c11a-4040-abb1-0d954ce1ae71 for instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d on hv-cinder-84456 Sep 26 10:35:23.775371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-2dfc4317-8149-4822-8925-3291d38af505 req-dd585a9c-6100-4459-bd39-4dcbee3d9572 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080742 Sep 26 10:35:23.776873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 201/397] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:23.783211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:23.784571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:23.794182 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.795021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.795696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.796669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.797446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.798557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:23.930585 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:23.935897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:23.950248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7830db92-6761-4923-b678-305e987e70e0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1710 microversion: 2.1 time: 0.705681 Sep 26 10:35:23.959636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a9749b65-40c3-4331-8af2-9615f05ed567 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1311 microversion: 2.1 time: 0.176831 Sep 26 10:35:23.960674 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 202/398] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:23 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1311 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:23.966766 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 197/399] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:23 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1710 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:23.981484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:23.982170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:23.985417 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:23.993194 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:23.993690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:23.994156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:24.001086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:24.001769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:24.003552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:24.289783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:24.299161 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b9bdd91f-e346-4190-a168-1a354a2a5b26 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.334775 Sep 26 10:35:24.321235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 203/400] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:23 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:24.978421 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:24.980517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:24.986878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:24.987503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:24.991964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:24.994068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:24.995281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:24.997185 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:24.998214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:24.999020 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:25.001561 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:25.002085 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:25.002538 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:25.003687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:25.003805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:25.004269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:25.126348 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:25.134924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e6cb0ec3-58e5-4807-b223-5027a8d97103 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1319 microversion: 2.1 time: 0.151850 Sep 26 10:35:25.137792 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 204/401] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:24 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:25.261954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:25.271153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3215ffb9-30c1-4bd0-9b61-91f33fa22955 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1710 microversion: 2.1 time: 0.297917 Sep 26 10:35:25.272025 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 198/402] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:24 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1710 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:25.275290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-e488069e-037a-43ad-ae49-abf2df3ffc6a req-561fda0a-82cc-4304-9031-f896d9236148 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c4900f-d778-4d9f-98f5-2657ff241a0e", "tag": "852a1cf1-997f-48f3-ba24-fee4c258bd27"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:25.296937 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e488069e-037a-43ad-ae49-abf2df3ffc6a req-561fda0a-82cc-4304-9031-f896d9236148 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:25.297680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e488069e-037a-43ad-ae49-abf2df3ffc6a req-561fda0a-82cc-4304-9031-f896d9236148 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:25.298388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-e488069e-037a-43ad-ae49-abf2df3ffc6a req-561fda0a-82cc-4304-9031-f896d9236148 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:25.311207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-e488069e-037a-43ad-ae49-abf2df3ffc6a req-561fda0a-82cc-4304-9031-f896d9236148 service nova] Creating event network-changed:852a1cf1-997f-48f3-ba24-fee4c258bd27 for instance 31c4900f-d778-4d9f-98f5-2657ff241a0e on hv-cinder-84456 Sep 26 10:35:25.316819 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-e488069e-037a-43ad-ae49-abf2df3ffc6a req-561fda0a-82cc-4304-9031-f896d9236148 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045840 Sep 26 10:35:25.318133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 205/403] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:35:25.331284 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:25.332062 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:25.339524 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:25.340825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:25.341358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:25.342245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:25.342785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:25.343307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:25.510769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:25.548987 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-09d67bdf-4d25-496c-bece-1f6d18b00828 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1366 microversion: 2.1 time: 0.210041 Sep 26 10:35:25.569226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 199/404] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:25 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:26.160341 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:26.161238 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:26.172774 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:26.173500 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:26.174779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:26.175737 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:26.176387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:26.177006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:26.258278 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:26.269455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ea474a2f-5651-475d-bf5a-156aa5081d1c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1317 microversion: 2.1 time: 0.112780 Sep 26 10:35:26.289180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 206/405] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:26 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1317 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:26.298879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:26.300158 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:26.313129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:26.313634 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:26.314155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:26.315538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:26.315538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:26.316521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:26.577398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:26.578040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:26.588189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:26.591582 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:26.594557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:26.596112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:26.598630 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:26.600157 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:26.951870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:26.961403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8e5e3bf6-5d5d-4666-9493-9f8b0a1d3433 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1710 microversion: 2.1 time: 0.666518 Sep 26 10:35:26.969710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 200/406] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:26 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1710 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:26.984012 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:26.997609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0d847cd1-53fd-4d35-a8e4-996ccf9ebbbd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1557 microversion: 2.1 time: 0.424427 Sep 26 10:35:26.998917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 207/407] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:26 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1557 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:27.022288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:27.022910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:27.032495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:27.034266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:27.036045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:27.036937 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:27.040388 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:27.040919 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:27.171523 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e6fdc330-1867-4fc5-b839-30d3ddcb13b0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.153205 Sep 26 10:35:27.172394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 201/408] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:35:27 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:27.297866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:27.299446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:27.332473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:27.333027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:27.333468 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:27.334471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:27.335314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:27.335953 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:27.747547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:27.755582 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fb3033ba-3fa7-401c-825d-5dab39f55830 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.462454 Sep 26 10:35:27.756159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 208/409] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:27 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:27.812685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-438a8944-c508-4e1a-a832-00b8487bd323 req-51bfe3de-3937-4a5f-82d3-54f848d0fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:27.830659 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-438a8944-c508-4e1a-a832-00b8487bd323 req-51bfe3de-3937-4a5f-82d3-54f848d0fc4f service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:27.833499 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-438a8944-c508-4e1a-a832-00b8487bd323 req-51bfe3de-3937-4a5f-82d3-54f848d0fc4f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:27.833938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-438a8944-c508-4e1a-a832-00b8487bd323 req-51bfe3de-3937-4a5f-82d3-54f848d0fc4f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:27.858201 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-438a8944-c508-4e1a-a832-00b8487bd323 req-51bfe3de-3937-4a5f-82d3-54f848d0fc4f service nova] Creating event network-changed:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:35:27.873519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-438a8944-c508-4e1a-a832-00b8487bd323 req-51bfe3de-3937-4a5f-82d3-54f848d0fc4f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065963 Sep 26 10:35:27.877712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 202/410] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:28.001000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:28.001627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:28.011160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:28.011644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:28.012120 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:28.012808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:28.032023 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:28.032487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:28.309714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:28.344420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c111fb64-f5f5-4611-a1ef-e553a3d51dbe tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1714 microversion: 2.1 time: 0.347739 Sep 26 10:35:28.372227 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 209/411] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:27 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1714 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:28.784604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:28.785723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:28.800652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:28.804384 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:28.807570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:28.808565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:28.810419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:28.813159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:29.149449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:29.159395 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d477293e-f681-4cda-afe1-032024629bda tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.378352 Sep 26 10:35:29.174455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 203/412] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:28 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:29.823379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-4cb46ba7-6527-45ce-b0f6-02341b5bed4e req-7dc6fd39-2245-4ddc-a872-567a337243f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c49866e-9fb8-4d0f-8e65-4cf8d565895d", "tag": "853197ed-c11a-4040-abb1-0d954ce1ae71"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:29.853761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4cb46ba7-6527-45ce-b0f6-02341b5bed4e req-7dc6fd39-2245-4ddc-a872-567a337243f8 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:29.854293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4cb46ba7-6527-45ce-b0f6-02341b5bed4e req-7dc6fd39-2245-4ddc-a872-567a337243f8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:29.854751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4cb46ba7-6527-45ce-b0f6-02341b5bed4e req-7dc6fd39-2245-4ddc-a872-567a337243f8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:29.913313 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-4cb46ba7-6527-45ce-b0f6-02341b5bed4e req-7dc6fd39-2245-4ddc-a872-567a337243f8 service nova] Creating event network-changed:853197ed-c11a-4040-abb1-0d954ce1ae71 for instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d on hv-cinder-84456 Sep 26 10:35:29.934753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-4cb46ba7-6527-45ce-b0f6-02341b5bed4e req-7dc6fd39-2245-4ddc-a872-567a337243f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113525 Sep 26 10:35:29.935415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 210/413] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:30.189936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:30.191663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:30.203347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:30.204084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:30.204687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:30.205946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:30.206587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:30.207190 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:30.413102 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:30.414118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:30.432355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:30.433418 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:30.436271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:30.437658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:30.438985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:30.441333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:30.542100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6a21fdcf-7919-4c37-ac32-67c39fa0d736 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/ips" status: 200 len: 152 microversion: 2.20 time: 0.138048 Sep 26 10:35:30.551262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 211/414] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Sep 26 10:35:30 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/ips => generated 152 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:35:30.803339 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:30.817259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e1843cb3-6a40-406d-bd9f-5c8164451ed9 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.630297 Sep 26 10:35:30.829305 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 204/415] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:30 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:31.853709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:31.854369 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:31.867378 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:31.870085 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:31.870962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:31.871924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:31.873594 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:31.875797 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:31.969128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=4 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:32.113199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:32.122403 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cf920cf5-2be9-4af0-b185-e21eaf857f08 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.274720 Sep 26 10:35:32.138274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 212/416] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:31 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:33.149697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:33.150471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:33.160044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:33.161109 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=8 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:33.163139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:33.164023 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:33.164671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:33.165591 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:33.166373 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:33.167005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:33.394688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:33.411667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-84fe3453-67bd-4ca0-b90c-7fda42b4b985 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.265815 Sep 26 10:35:33.444468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 205/417] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:33 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:34.447539 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:34.448237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:34.459733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:34.460963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:34.461443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:34.462361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:34.462851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:34.463476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:34.489726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:34.649122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:34.664752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5c2bd09b-3823-4483-8792-c7e05e6f9317 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.220999 Sep 26 10:35:34.665807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 213/418] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:34 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:35.053240 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:35.053928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:35.055709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:35.081106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:35.081930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:35.083482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:35.086842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:35.089740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:35.091254 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:35.134544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lazy-loading 'flavor' on Instance uuid 05d17109-d4ce-4939-89c1-efb485f67ada {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:35:35.689961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:35.690854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:35.698873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:35.699645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:35.700262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:35.701150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:35.701978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:35.702777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:35.914917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:35.932408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1fb41c2d-144e-4030-83de-e73fd9ff1c16 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.247137 Sep 26 10:35:35.933949 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 214/419] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:35 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:36.964204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:36.966479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:36.973624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:36.974246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:36.974753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:36.975549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:36.976578 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:36.977219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:37.202870 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:37.219375 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8be794b0-04cc-4a9d-b712-ee236982ae5f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.262249 Sep 26 10:35:37.227986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 215/420] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:36 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:38.246886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:38.248357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:38.255303 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:38.255867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:38.256732 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:38.257465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:38.257948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:38.258401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:38.441447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:38.456559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-511f32e6-1585-4520-b3a1-358907362d14 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.217013 Sep 26 10:35:38.463143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 216/421] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:38 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:39.481749 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:39.482560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:39.489447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:39.489935 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:39.490393 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:39.491090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:39.492490 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:39.492920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:39.654872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-28486de1-0544-4ee2-a6a3-79298dbbb5db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/action" status: 202 len: 0 microversion: 2.20 time: 4.605145 Sep 26 10:35:39.658972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 206/422] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 10:35:35 2022] POST /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/action => generated 0 bytes in 4610 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:35:39.664788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:39.665543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:39.672626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:39.673114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:39.673538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:39.674486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:39.675125 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:39.675736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:39.678923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:39.688762 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2f51ea45-ceb4-42fb-8464-3080f1a248f1 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.211244 Sep 26 10:35:39.689560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 217/423] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:39 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:39.833164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:39.843020 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:39.844571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:39.845841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d9e65a8e-fa67-49ee-ba67-120de5c583c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.185385 Sep 26 10:35:39.858980 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 207/424] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:39 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:40.712627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:40.713430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:40.720880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:40.721730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:40.722421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:40.723248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:40.724753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:40.725263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:40.861231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:40.873109 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:40.873718 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:40.878665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d476ff0c-251e-46e7-b105-4a0edbe245df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.170179 Sep 26 10:35:40.879522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 218/425] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:40 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:40.880723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:40.881401 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:40.881834 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:40.882551 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:40.883000 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:40.883415 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:41.025602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:41.034283 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:41.035749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:41.037069 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9f938622-eac2-42d6-b4e0-d90aa86700d5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.168303 Sep 26 10:35:41.037645 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 208/426] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:40 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:35:41.902947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:41.903785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:41.910452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:41.910940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:41.911460 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:41.912056 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:41.912510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:41.912932 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:42.061731 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:42.063103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:42.063717 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:42.070141 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0af57661-ef1c-4645-9206-24b623bd6eb0 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.171556 Sep 26 10:35:42.070584 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:42.070745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 219/427] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:41 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:35:42.071558 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:42.072170 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:42.073036 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:42.073496 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:42.074840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:42.216765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:42.225145 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:42.226902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:42.228115 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d9f33772-e3ab-401d-8ff3-57563b5734bf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.168883 Sep 26 10:35:42.228754 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 209/428] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:42 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:43.094339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:43.094892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:43.100802 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:43.101583 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:43.102042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:43.102729 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:43.103212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:43.103637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:43.252897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:43.253702 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:43.260645 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:43.261215 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:43.261755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:43.262583 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:43.263463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:43.264063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:43.362225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:43.371377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a879d771-8753-4598-b636-41c5cb59ab98 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.281446 Sep 26 10:35:43.374451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 220/429] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:43 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:43.507932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:43.518710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:43.520561 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:43.521888 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f8dde3aa-2c33-4627-9f84-c65a94655e1a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.273028 Sep 26 10:35:43.523025 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 210/430] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:43 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:35:44.398410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:44.402177 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:44.409130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:44.409610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:44.410061 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:44.410946 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:44.411399 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:44.411952 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:44.549494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:44.551334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:44.553155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:44.559787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:44.560838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:44.561542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:44.562269 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:44.562561 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9d575c99-1900-48ff-a8da-d11591d05511 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.167966 Sep 26 10:35:44.562887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:44.563307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:44.574586 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 221/431] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:44 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:44.714584 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:44.723862 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:44.725321 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:44.726759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1f0665a8-7e24-4776-9ea4-59365ca440c7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.181659 Sep 26 10:35:44.727308 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 211/432] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:44 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:45.586480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:45.587285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:45.594068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:45.594563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:45.595002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:45.595709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:45.596176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:45.596694 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:45.733558 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:45.741408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-61ffcf6d-2ede-4c5a-9c1a-64e3e120d74f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.159011 Sep 26 10:35:45.741989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 222/433] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:45 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:45.754655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:45.755342 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:45.761445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:45.761941 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:45.762406 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:45.763098 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:45.763547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:45.763967 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:45.766744 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:45.787392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-b333dc67-444a-4fdb-989b-0ccf3dcbdb7a req-f7437e79-f02a-455b-b6f8-eae9a6233910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "name": "network-vif-plugged", "status": "completed", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:45.799753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b333dc67-444a-4fdb-989b-0ccf3dcbdb7a req-f7437e79-f02a-455b-b6f8-eae9a6233910 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:45.800220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b333dc67-444a-4fdb-989b-0ccf3dcbdb7a req-f7437e79-f02a-455b-b6f8-eae9a6233910 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:45.800865 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b333dc67-444a-4fdb-989b-0ccf3dcbdb7a req-f7437e79-f02a-455b-b6f8-eae9a6233910 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:45.814403 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-b333dc67-444a-4fdb-989b-0ccf3dcbdb7a req-f7437e79-f02a-455b-b6f8-eae9a6233910 service nova] Creating event network-vif-plugged:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:35:45.819802 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-b333dc67-444a-4fdb-989b-0ccf3dcbdb7a req-f7437e79-f02a-455b-b6f8-eae9a6233910 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036392 Sep 26 10:35:45.820621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 223/434] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:45.913585 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:45.922593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:45.924072 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:45.925221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-158dae2d-bf3b-4f7d-92bf-856208dc9656 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.174955 Sep 26 10:35:45.925797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 212/435] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:45 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:46.766548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:46.767257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:46.773261 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:46.773757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:46.774234 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:46.774939 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:46.775397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:46.776002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:46.911528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:46.919386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-79a16e68-b635-42e6-a1f5-94a02b91579d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.158423 Sep 26 10:35:46.919963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 224/436] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:46 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:46.952587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:46.953219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:46.959046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:46.959522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:46.959956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:46.960624 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:46.961068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:46.961511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:47.094071 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:47.102249 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:47.103687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:47.104825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f031f44a-a13a-48b5-9006-94e46c6de26f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.156724 Sep 26 10:35:47.105882 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 213/437] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:46 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:47.942921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:47.944088 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:47.951231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:47.951797 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:47.952249 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:47.952940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:47.953391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:47.953812 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:48.092842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:48.102085 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-267cd3b0-5cfc-4351-bbdc-72abf5318ed6 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1359 microversion: 2.1 time: 0.163053 Sep 26 10:35:48.103039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 225/438] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:47 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:48.130787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:48.131442 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:48.137687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:48.138276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:48.138736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:48.139417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:48.139863 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:48.140358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:48.274569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:48.282474 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:48.283918 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:48.285092 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-35aeab62-960e-4975-8166-b3cd546f980f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.158265 Sep 26 10:35:48.285649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 214/439] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:48 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:49.127542 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:49.128307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:49.139890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.140524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.141013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.141801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.142297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.142762 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.274183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.282690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-63dc6890-05e2-4898-98d6-496a3c47677c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1548 microversion: 2.1 time: 0.159357 Sep 26 10:35:49.283254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 226/440] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:49 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:49.306446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:49.307052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:49.309991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:49.310577 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:49.313009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.313495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.313945 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.314639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.315259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.315793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.316584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.317069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.317509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.318322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.318793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.319196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.523569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.526347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.532627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0b7ba0d0-d6fb-443e-97fd-9b644866cd9a tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1548 microversion: 2.1 time: 0.229934 Sep 26 10:35:49.533056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 215/441] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:49 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1548 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:49.536000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.537442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.538621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0ea815bd-9962-455c-84d2-db54b514b8b7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.232475 Sep 26 10:35:49.539155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 227/442] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:49 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:35:49.553537 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:49.558428 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.559251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Searching by: {'deleted': False, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1'} {{(pid=127055) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 26 10:35:49.565860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.566258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.566692 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.567392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.567844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.568261 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.656928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.multi_cell_list [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127055) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 26 10:35:49.750859 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cdc35515-fada-4314-a98b-2d2de4152e58 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200919 Sep 26 10:35:49.751436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 216/443] 10.222.0.49 () {58 vars in 1125 bytes} [Mon Sep 26 10:35:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:49.763494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:49.764110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:49.770011 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.770533 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.770968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.771652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:49.772105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:49.772531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:49.898193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:49.905892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-69d01f22-6556-4d1f-a2ba-156738700454 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1548 microversion: 2.1 time: 0.146749 Sep 26 10:35:49.906481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 228/444] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:35:49 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:35:50.563878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:50.564588 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:50.570988 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:50.571466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:50.571907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:50.572586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:50.573019 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:50.573434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:50.698290 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:50.706307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:50.707750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:50.708883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-630964c1-84bb-4b1a-88aa-c51fe3d22175 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.149021 Sep 26 10:35:50.709434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 217/445] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:50 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:51.447596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd483d93-0073-4c6b-b616-57d2562ec908"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:51.450729 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:51.457147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:51.457628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:51.458087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:51.458781 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:51.459236 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:51.459658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:51.602334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:51.721458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7b160769-0efa-4790-bc2d-a69ee3a016ff tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276831 Sep 26 10:35:51.722150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 229/446] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:35:51 2022] POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:35:51.737450 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:51.738260 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:51.745038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:51.745933 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:51.747268 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:51.748046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:51.748504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:51.749050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:51.923232 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:51.934451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:51.935930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:51.937096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-eae3871d-99e6-4bab-9bba-d18e5cf50933 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.204335 Sep 26 10:35:51.937657 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 218/447] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:51 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:52.962693 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:52.963386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:52.970061 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:52.970546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:52.970974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:52.971665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:52.972100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:52.972515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:53.101293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:53.109895 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:53.111364 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:53.112500 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c29b2de0-576d-433a-9dfb-dfb6081e875d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.154082 Sep 26 10:35:53.113050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 230/448] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:52 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:54.137457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:54.138093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:54.144022 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:54.144500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:54.144928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:54.145599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:54.146071 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:54.146600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:54.275964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:54.284595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:54.286058 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:54.287201 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0bfab3db-193c-4a03-b292-742fe6452ca7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.153725 Sep 26 10:35:54.287758 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 219/449] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:54 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:35:55.313380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:55.314042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:55.316444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=56 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:35:55.321590 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:55.322095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:55.322535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:55.323224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:55.323680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:55.324139 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:55.453012 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:55.461391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:55.462948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:55.464237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8544f134-2a79-4d6f-99ad-51e37895bab9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.154778 Sep 26 10:35:55.464815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 231/450] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:55 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:56.491929 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:56.492623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:56.499921 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:56.500438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:56.500872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:56.501571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:56.502041 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:56.502474 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:56.649956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:56.658006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:56.659456 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:56.660594 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3eb8dd83-a16f-4f6c-bb42-3433262b39af tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1746 microversion: 2.20 time: 0.174212 Sep 26 10:35:56.661146 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 220/451] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:56 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:57.687305 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:57.688049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:57.694691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:57.695177 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:57.695624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:57.696322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:57.696952 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:57.697387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:57.854980 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:57.868960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:57.870608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:57.872568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7680fa5f-b578-4077-866f-93d2a6e1fd0f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1746 microversion: 2.20 time: 0.189895 Sep 26 10:35:57.873172 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 232/452] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:57 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1746 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:58.899468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:35:58.900680 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:35:58.907299 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:58.907978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:58.908558 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:58.909688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:58.910322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:58.910743 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:59.052108 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:59.060895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:59.062354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:35:59.063581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c46b2061-9fba-4336-a8af-20906e1196d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.169290 Sep 26 10:35:59.064032 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 221/453] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:35:58 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:35:59.755708 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-a5763448-37cc-4f9a-a4ec-b9ce2a554677 req-452790b6-1e80-498c-9acf-86cf201f4b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "name": "network-vif-plugged", "status": "completed", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:35:59.767089 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a5763448-37cc-4f9a-a4ec-b9ce2a554677 req-452790b6-1e80-498c-9acf-86cf201f4b64 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:35:59.767711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a5763448-37cc-4f9a-a4ec-b9ce2a554677 req-452790b6-1e80-498c-9acf-86cf201f4b64 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:35:59.768181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a5763448-37cc-4f9a-a4ec-b9ce2a554677 req-452790b6-1e80-498c-9acf-86cf201f4b64 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:35:59.786923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-a5763448-37cc-4f9a-a4ec-b9ce2a554677 req-452790b6-1e80-498c-9acf-86cf201f4b64 service nova] Creating event network-vif-plugged:80a6fd45-6996-4b15-93f6-3122e122a647 for instance 05d17109-d4ce-4939-89c1-efb485f67ada on hv-cinder-84456 Sep 26 10:35:59.797922 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-a5763448-37cc-4f9a-a4ec-b9ce2a554677 req-452790b6-1e80-498c-9acf-86cf201f4b64 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046339 Sep 26 10:35:59.799229 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 233/454] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:00.094054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:00.094680 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:00.096538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:00.106245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:00.106776 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:00.107849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:00.108602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:00.109072 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:00.109508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:00.322519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:00.334622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:00.336635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:00.338152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d4263666-1600-4607-9858-1f1c33da2b9a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.248600 Sep 26 10:36:00.338838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 222/455] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:00 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:01.366748 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:01.368338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:01.376067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:01.376843 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:01.377466 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:01.378788 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:01.379160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:01.379711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:01.583289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:01.593840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:01.595842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:01.597371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c11321ce-e800-44d8-b545-36239c0e3b1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.236966 Sep 26 10:36:01.598676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 234/456] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:01 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:02.624180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:02.625453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:02.626281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:02.628355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:02.638942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:02.639193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:02.639628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:02.640070 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:02.640450 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:02.641117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:02.641497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:02.641966 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:02.642425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:02.642758 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:02.643420 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:02.644070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:02.907954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:02.911033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:02.921453 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2d9ba050-30b5-4217-b10a-99f3709e709b tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1594 microversion: 2.1 time: 0.301111 Sep 26 10:36:02.921953 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:02.922674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 223/457] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:02 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1594 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:02.930234 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:02.930234 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-044c9420-71a8-41ff-8724-c2e8768b7a20 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.304316 Sep 26 10:36:02.930234 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 235/458] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:02 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:03.956510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:03.957218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:03.963785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:03.964265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:03.965457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:03.966365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:03.966967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:03.967548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:04.150100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:04.176600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:04.179517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:04.181030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2def62c9-5f9c-40ce-86ad-e6f856a3b6d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.228338 Sep 26 10:36:04.181862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 236/459] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:03 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:05.212755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:05.214238 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:05.219847 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=36 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:05.221587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:05.222542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:05.223506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:05.224894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:05.226315 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:05.227617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:05.422457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:05.459206 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:05.460661 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:05.469350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fd42af05-e8a9-4426-9b5f-5bd76be5d489 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.260687 Sep 26 10:36:05.470730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 224/460] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:05 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:05.532465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-05c9c809-1acc-40d6-aefe-92eaba0271a6 req-50a7829c-d107-4f94-80ba-501b78ac8b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:05.546839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-05c9c809-1acc-40d6-aefe-92eaba0271a6 req-50a7829c-d107-4f94-80ba-501b78ac8b62 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:05.547510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-05c9c809-1acc-40d6-aefe-92eaba0271a6 req-50a7829c-d107-4f94-80ba-501b78ac8b62 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:05.548107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-05c9c809-1acc-40d6-aefe-92eaba0271a6 req-50a7829c-d107-4f94-80ba-501b78ac8b62 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:05.573245 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-05c9c809-1acc-40d6-aefe-92eaba0271a6 req-50a7829c-d107-4f94-80ba-501b78ac8b62 service nova] Creating event network-changed:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:36:05.582084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-05c9c809-1acc-40d6-aefe-92eaba0271a6 req-50a7829c-d107-4f94-80ba-501b78ac8b62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054711 Sep 26 10:36:05.583738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 237/461] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:06.500529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:06.501133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:06.521312 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:06.521922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:06.522620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:06.524054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:06.524809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:06.525516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:06.832369 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:06.856409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:06.858473 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:06.861802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-695c9e36-0d41-4b82-9620-7a5fb91cb777 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.365568 Sep 26 10:36:06.878567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 225/462] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:06 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:07.432615 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1172863596"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:07.433243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:07.445623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:07.446645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:07.447703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:07.450667 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:07.451630 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:07.452724 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:07.617840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.network.security_group_api [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Adding security group 9a1b72b1-178f-494b-b00c-78edf514c9a7 to port c3b3988b-57fd-4956-8209-afc0f13b21e0 Sep 26 10:36:07.893554 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:07.894918 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:07.901623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:07.902171 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:07.910652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:07.911535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:07.912050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:07.912592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:08.314427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:08.324596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:08.326274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:08.327726 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cef0ee05-78f5-4077-aadf-c6b5c5d6d955 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.441189 Sep 26 10:36:08.328387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 226/463] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:07 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:08.370722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1387980b-2bcc-4b65-983a-3e20e701e037 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/action" status: 202 len: 0 microversion: 2.1 time: 0.942826 Sep 26 10:36:08.373518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 238/464] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:36:07 2022] POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:36:08.384539 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:08.385483 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:08.395571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:08.396410 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:08.396551 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:08.397274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:08.397740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:08.398208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:08.402112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-fc6884a9-3203-425b-8e42-716897994c35 req-dee94324-4cf0-4ae0-a2fe-6ad8b2f14807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:08.420344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fc6884a9-3203-425b-8e42-716897994c35 req-dee94324-4cf0-4ae0-a2fe-6ad8b2f14807 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:08.422903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fc6884a9-3203-425b-8e42-716897994c35 req-dee94324-4cf0-4ae0-a2fe-6ad8b2f14807 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:08.424510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fc6884a9-3203-425b-8e42-716897994c35 req-dee94324-4cf0-4ae0-a2fe-6ad8b2f14807 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:08.445240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-fc6884a9-3203-425b-8e42-716897994c35 req-dee94324-4cf0-4ae0-a2fe-6ad8b2f14807 service nova] Creating event network-changed:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:36:08.451062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-fc6884a9-3203-425b-8e42-716897994c35 req-dee94324-4cf0-4ae0-a2fe-6ad8b2f14807 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056447 Sep 26 10:36:08.453115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 239/465] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:08.724737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:08.734376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a0f51c40-30c1-4083-bf29-522bfdfdbeb8 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1760 microversion: 2.1 time: 0.356306 Sep 26 10:36:08.740600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 227/466] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:08 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1760 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:09.374808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:09.375514 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:09.381729 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:09.382254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:09.382695 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:09.383419 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:09.383881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:09.384339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:09.535083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:09.544211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:09.545682 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:09.546971 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a80d4b01-3aed-4268-8f03-a2dbc387541c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1741 microversion: 2.20 time: 0.176728 Sep 26 10:36:09.547545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 240/467] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:09 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:10.573095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:10.573702 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:10.580590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:10.581026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:10.581455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:10.582161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:10.582605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:10.583030 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:10.600218 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=100 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:10.718530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:10.727355 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:10.728793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:10.729927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-80ad573e-ce57-4689-bba9-8fe7735cba2d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1723 microversion: 2.20 time: 0.161155 Sep 26 10:36:10.730516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 228/468] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:10 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:11.755442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:11.756121 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:11.763335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:11.763830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:11.764966 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:11.765755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:11.766252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:11.766751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:11.896831 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:11.904828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:11.906877 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:11.908029 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b718cfd0-f9c7-4c09-8b5c-31bd12715264 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1723 microversion: 2.20 time: 0.156543 Sep 26 10:36:11.908668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 241/469] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:11 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:12.934515 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:12.935067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:12.941770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:12.942302 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:12.942742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:12.943504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:12.943959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:12.944383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.070949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:13.079597 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:13.081055 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:13.082228 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4d11a79a-7ff0-48a5-982f-073648ab96e1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1666 microversion: 2.20 time: 0.151875 Sep 26 10:36:13.082785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 229/470] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:12 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:13.106945 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "016e290a-16f6-4f86-b2de-b85feb476c15"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:13.109332 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:13.115621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.116107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.116537 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.117215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.117661 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.118103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.394874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-955b7910-2cf7-4ed6-8de8-07c77117220c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.291904 Sep 26 10:36:13.395486 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 242/471] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Sep 26 10:36:13 2022] POST /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments => generated 188 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:36:13.521018 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:13.521641 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:13.527771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.528257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.528692 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.529384 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.529836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.530298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.574461 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127055) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 10:36:13.638005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-85b98090-b670-4bd3-9a1a-4a60d7a687d4 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/action" status: 202 len: 0 microversion: 2.20 time: 0.120906 Sep 26 10:36:13.638827 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 230/472] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 10:36:13 2022] POST /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:36:13.646821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:13.647428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:13.653321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.654219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.654326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.655505 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.655957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.656378 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.771043 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-5f8bd567-c31f-49d0-a83f-c070d5ca5dc3 req-54d406c0-61c7-4779-8ec7-08de30bad6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "name": "network-vif-unplugged", "status": "completed", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:13.783535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-5f8bd567-c31f-49d0-a83f-c070d5ca5dc3 req-54d406c0-61c7-4779-8ec7-08de30bad6d5 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:13.784042 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-5f8bd567-c31f-49d0-a83f-c070d5ca5dc3 req-54d406c0-61c7-4779-8ec7-08de30bad6d5 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:13.784476 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-5f8bd567-c31f-49d0-a83f-c070d5ca5dc3 req-54d406c0-61c7-4779-8ec7-08de30bad6d5 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:13.810618 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.compute.server_external_events [req-5f8bd567-c31f-49d0-a83f-c070d5ca5dc3 req-54d406c0-61c7-4779-8ec7-08de30bad6d5 service nova] Unable to find a host for instance 05d17109-d4ce-4939-89c1-efb485f67ada. Dropping event network-vif-unplugged {{(pid=127055) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 26 10:36:13.811678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-5f8bd567-c31f-49d0-a83f-c070d5ca5dc3 req-54d406c0-61c7-4779-8ec7-08de30bad6d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045945 Sep 26 10:36:13.812542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 231/473] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 26 10:36:13.822041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:13.832018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:13.833467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:13.834662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e502ee7c-8a0e-4a1f-a4b4-f7b4255b8f3d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1752 microversion: 2.20 time: 0.191712 Sep 26 10:36:13.850299 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 243/474] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:13 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:14.861418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:14.862050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:14.867993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:14.868468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:14.868914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:14.869600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:14.870047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:14.870469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:14.995991 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:15.004871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:15.006344 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:15.007506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f4b441e2-bc46-436c-935a-1cfd2d593765 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1754 microversion: 2.20 time: 0.150411 Sep 26 10:36:15.008065 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 232/475] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:14 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:16.032734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:16.033350 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:16.039936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:16.040416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:16.040850 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:16.041537 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:16.041985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:16.042431 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:16.223065 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:16.232628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:16.233619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:16.234872 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-acab3438-9d5c-4a9a-816d-3e3c7c07107a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.206079 Sep 26 10:36:16.235626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 244/476] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:16 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:17.261991 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:17.262744 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:17.269299 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:17.269796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:17.270262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:17.270971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:17.271430 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:17.271856 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:17.426720 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:17.435717 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:17.442311 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:17.443605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-edc37dc1-5b75-4cee-8c57-ffa7e0287493 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.185747 Sep 26 10:36:17.444482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 233/477] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:17 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:18.470105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:18.470623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:18.478061 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:18.478675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:18.479193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:18.480100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:18.480642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:18.481083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:18.497104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:18.627816 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:18.636759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:18.638522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:18.640262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8f7397f4-b5fa-4bd9-aa87-47a8dcddd977 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.174654 Sep 26 10:36:18.640901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 245/478] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:18 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:19.665819 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:19.666598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:19.673097 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:19.673590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:19.674048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:19.675077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:19.675535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:19.675963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:19.841378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:19.851155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:19.852999 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:19.854290 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b38164fa-d227-49b1-a93c-3a07974fc7eb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.192538 Sep 26 10:36:19.854949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 234/479] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:19 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:20.880679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:20.881927 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:20.888615 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:20.890826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:20.891476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:20.892559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:20.893277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:20.893897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:21.035056 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:21.043788 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:21.045378 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:21.046650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1dc9279b-575d-442f-8a62-13c8dc0013b0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.170270 Sep 26 10:36:21.047271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 246/480] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:20 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:21.230213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b034a4d-9ff5-4b95-b517-ea63127e283b"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:21.232440 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:21.238551 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:21.239038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:21.239475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:21.240173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:21.240625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:21.241056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:22.071962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:22.072567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:22.078938 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:22.079419 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:22.079864 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:22.080547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:22.081002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:22.081427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:22.215482 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:22.225252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:22.226731 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:22.228172 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-004d647a-67c5-4e9e-9f74-5fe1a56f3f46 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.160195 Sep 26 10:36:22.228728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 247/481] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:22 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:23.255125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:23.255930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:23.262686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:23.263166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:23.263596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:23.264835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:23.270923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:23.271383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:23.502692 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:23.517734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:23.520205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:23.521546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8cf4d345-e708-4aec-8da3-5d7fdb86cb9b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.270992 Sep 26 10:36:23.522414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 248/482] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:23 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:23.932896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:23.933689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:23.950665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:23.954759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:23.955368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:23.956246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:23.956852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:23.959986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.021286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-aa253102-6462-4e60-88e5-cdd32982a6c2 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/ips" status: 200 len: 151 microversion: 2.1 time: 0.092120 Sep 26 10:36:24.022374 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 249/483] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:36:23 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/ips => generated 151 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:36:24.037081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2a3775a-385c-4759-8ee1-cbdc8413a7f9"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:24.039898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:24.046516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.047009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.047447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.048148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.048597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.049222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.190232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Invalid volume: volume f2a3775a-385c-4759-8ee1-cbdc8413a7f9 is already attached to instances: bbcde70f-d1b6-40ce-8bcd-d17b1986f320 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: POST /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/os-volume_attachments HTTP/1.1 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 74 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:36:24.191962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {"volumeAttachment": {"volumeId": "f2a3775a-385c-4759-8ee1-cbdc8413a7f9"}} Sep 26 10:36:24.193338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Invalid volume: volume f2a3775a-385c-4759-8ee1-cbdc8413a7f9 is already attached to instances: bbcde70f-d1b6-40ce-8bcd-d17b1986f320 Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'server_id': '0c49866e-9fb8-4d0f-8e65-4cf8d565895d', 'body': {'volumeAttachment': {'volumeId': 'f2a3775a-385c-4759-8ee1-cbdc8413a7f9'}}} Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f2a3775a-385c-4759-8ee1-cbdc8413a7f9 is already attached to instances: bbcde70f-d1b6-40ce-8bcd-d17b1986f320 Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:24.194924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f2a3775a-385c-4759-8ee1-cbdc8413a7f9 is already attached to instances: bbcde70f-d1b6-40ce-8bcd-d17b1986f320 Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:24.196207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f2a3775a-385c-4759-8ee1-cbdc8413a7f9 is already attached to instances: bbcde70f-d1b6-40ce-8bcd-d17b1986f320 Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 400 to user: Invalid volume: volume f2a3775a-385c-4759-8ee1-cbdc8413a7f9 is already attached to instances: bbcde70f-d1b6-40ce-8bcd-d17b1986f320 {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-78b57766-c4e4-48ca-b0da-bb1e86e3098d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.160885 Sep 26 10:36:24.198105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 250/484] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:36:24 2022] POST /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d/os-volume_attachments => generated 174 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 10:36:24.208870 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:24.210362 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:24.217772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.218600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.219383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.220345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.220987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.221608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.252292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:36:24.369215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-85318b38-8575-4191-9d09-03e999002c3f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 204 len: 0 microversion: 2.1 time: 0.168246 Sep 26 10:36:24.370282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 251/485] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:36:24 2022] DELETE /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:36:24.380044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:24.380913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:24.387747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.388488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.389082 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.389867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.390436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.391020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.564781 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:24.572780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5a4f2187-24a5-402f-a693-c1d959f645d9 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1682 microversion: 2.1 time: 0.197704 Sep 26 10:36:24.587156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 252/486] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:24 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:24.598635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:24.601257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:24.608851 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.609712 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.610398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.611331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:24.611991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:24.612627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:24.790436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:24.804965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:24.808563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:24.810340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-44e6d60b-f9a7-435c-b6be-a65a72317663 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.218153 Sep 26 10:36:24.811441 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 253/487] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:24 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:25.601610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:25.602528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:25.609174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:25.619693 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:25.620205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:25.620854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:25.621595 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:25.622087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:25.622521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:25.822198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:25.830519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b879f0ac-61cf-49f0-92fe-eaf81a9aac51 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1682 microversion: 2.1 time: 0.232656 Sep 26 10:36:25.831099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 254/488] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:25 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:25.846658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:25.847281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:25.853993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:25.854570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:25.855009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:25.855956 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:25.856813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:25.857273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:26.006415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:26.016725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:26.018373 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:26.019621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-05064858-1df2-47bf-9825-7595ca4a41c1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.184618 Sep 26 10:36:26.020173 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 255/489] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:25 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:26.854574 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:26.855186 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:26.862827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:26.863478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:26.863958 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:26.864801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:26.865262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:26.865769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:26.993821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:27.001360 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9be44a8b-4615-4d3f-95ee-ba720b44684d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1682 microversion: 2.1 time: 0.150953 Sep 26 10:36:27.001943 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 256/490] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:26 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:27.046530 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:27.047130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:27.052785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:27.053263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:27.053695 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:27.054392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:27.054841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:27.055257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:27.190109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:27.198575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:27.200009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:27.201154 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a8c7984b-0deb-4f9a-8313-4fd938ce24a0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.159116 Sep 26 10:36:27.202314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 257/491] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:27 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:27.633222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:27.633738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:27.639728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:27.640210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:27.640642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:27.641325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:27.641779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:27.642235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:27.763990 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lazy-loading 'services' on Instance uuid 9ca6fe02-8975-4daa-a713-5ec2520b2d67 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:36:27.873039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-342c6f1b-24cf-4f1a-97ae-2c6cf77e29f0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-volume_attachments/7f1cfbe9-4856-490c-857d-a290d414f5c7" status: 202 len: 0 microversion: 2.1 time: 0.243495 Sep 26 10:36:27.874329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 258/492] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:36:27 2022] DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-volume_attachments/7f1cfbe9-4856-490c-857d-a290d414f5c7 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:36:28.025223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:28.025917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:28.033107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:28.033597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:28.034044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:28.034751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:28.035204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:28.035624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:28.165039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:28.173191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5b2fdc66-441c-41ba-8e0f-1577d2b83c07 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1682 microversion: 2.1 time: 0.152172 Sep 26 10:36:28.173763 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 259/493] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:28 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:28.225672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:28.226576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:28.232425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:28.233523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:28.233960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:28.234675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:28.235125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:28.235560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:28.239446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:28.364581 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:28.373080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:28.377130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:28.377130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ff88456d-64e8-43c8-aa56-c9e1505cf8cf tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.153624 Sep 26 10:36:28.377130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 260/494] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:28 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:29.196138 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:29.196734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:29.203435 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:29.204262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:29.204488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:29.205179 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:29.205735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:29.206120 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:29.279546 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0cb3bcd0-532a-49bf-91a7-562d54058f78 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.053454 Sep 26 10:36:29.280981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 235/495] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:36:21 2022] POST /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 194 bytes in 8056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:29.354823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:29.362898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a533682e-f038-4e23-bede-612772561082 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1682 microversion: 2.1 time: 0.170762 Sep 26 10:36:29.363452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 261/496] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:29 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:29.405699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:29.406425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:29.413142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:29.413626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:29.414082 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:29.414774 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:29.415228 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:29.415709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:29.555265 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:29.563812 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:29.565262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:29.566444 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1f0bf038-f68c-4dad-ba11-f1280929e3c3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.165945 Sep 26 10:36:29.567006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 236/497] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:29 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:30.386969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:30.387721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:30.396662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:30.397509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:30.398050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:30.398963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:30.399684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:30.400190 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:30.592770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:30.593341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:30.600019 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:30.600506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:30.600940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:30.601645 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:30.602377 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:30.602807 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:30.736483 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:30.744450 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-98b29690-5c54-4426-8992-b9892c75326c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1614 microversion: 2.1 time: 0.361741 Sep 26 10:36:30.745118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 262/498] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:30 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1614 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:30.886306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:30.894857 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:30.896317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:30.897476 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ad9ddb0e-fbf8-4887-b415-371874c12382 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.309206 Sep 26 10:36:30.898046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 237/499] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:30 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:36:30.974680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-649380e3-8e48-4c46-8ea0-d69a46e79740 req-2be30200-d431-40b7-bec9-42e49de823a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c49866e-9fb8-4d0f-8e65-4cf8d565895d", "name": "network-vif-deleted", "tag": "853197ed-c11a-4040-abb1-0d954ce1ae71"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:30.993288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-649380e3-8e48-4c46-8ea0-d69a46e79740 req-2be30200-d431-40b7-bec9-42e49de823a3 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:30.993707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-649380e3-8e48-4c46-8ea0-d69a46e79740 req-2be30200-d431-40b7-bec9-42e49de823a3 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:30.994207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-649380e3-8e48-4c46-8ea0-d69a46e79740 req-2be30200-d431-40b7-bec9-42e49de823a3 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.007604 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-649380e3-8e48-4c46-8ea0-d69a46e79740 req-2be30200-d431-40b7-bec9-42e49de823a3 service nova] Creating event network-vif-deleted:853197ed-c11a-4040-abb1-0d954ce1ae71 for instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d on hv-cinder-84456 Sep 26 10:36:31.012448 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-649380e3-8e48-4c46-8ea0-d69a46e79740 req-2be30200-d431-40b7-bec9-42e49de823a3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042125 Sep 26 10:36:31.013376 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 263/500] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:31.114984 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4da9c577-7442-497b-b151-7ae2c3ce10fb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:31.122494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4da9c577-7442-497b-b151-7ae2c3ce10fb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.123033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4da9c577-7442-497b-b151-7ae2c3ce10fb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.123500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4da9c577-7442-497b-b151-7ae2c3ce10fb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.148219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4da9c577-7442-497b-b151-7ae2c3ce10fb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Going to try to stop instance {{(pid=127055) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 26 10:36:31.212359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4da9c577-7442-497b-b151-7ae2c3ce10fb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action" status: 202 len: 0 microversion: 2.1 time: 0.102393 Sep 26 10:36:31.213039 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 238/501] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:36:31 2022] POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 10:36:31.223455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:31.224160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:31.231776 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.233535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.234228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.235126 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.235792 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.236736 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.392598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:31.401692 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-dc2feb15-5b40-4a34-ad54-5acd6f2fe693 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.182389 Sep 26 10:36:31.402332 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 264/502] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:31 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:31.770156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:31.770868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:31.777542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.778068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.778544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.779347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.780027 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.780452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.818241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.818733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.819169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.819619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lazy-loading 'fault' on Instance uuid 0c49866e-9fb8-4d0f-8e65-4cf8d565895d {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:36:31.869142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:31.877319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0e189f39-d4db-4cbe-8278-f11469aadb9b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 200 len: 1330 microversion: 2.1 time: 0.111646 Sep 26 10:36:31.878221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 239/503] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:31 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 1330 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:31.925277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:31.927371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:31.938227 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.938891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.940249 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:31.942496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:31.943255 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:31.944210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:32.098416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:32.108310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:32.109911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:32.111264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9d9e3419-296e-4181-a8eb-952f173fa8a8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.190112 Sep 26 10:36:32.112122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 265/504] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:31 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:32.425393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:32.425917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:32.432385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:32.432877 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:32.433305 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:32.433994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:32.434487 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:32.434910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:32.569226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:32.576935 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9aa5a90a-0795-4755-be80-502a9b49d717 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.155465 Sep 26 10:36:32.577505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 240/505] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:32 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:32.904103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:32.905306 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:32.911712 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:32.912197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:32.912634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:32.913324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:32.913896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:32.914354 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:32.928001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d HTTP/1.1 Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:36:32.929654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:36:32.931243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '0c49866e-9fb8-4d0f-8e65-4cf8d565895d'} Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:36:32.932071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:36:32.933528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:32.934889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:36:32.934889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e70cab08-10e8-47c7-8596-c72dca648cf8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 404 len: 111 microversion: 2.1 time: 0.030808 Sep 26 10:36:32.934889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 266/506] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:32 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:36:32.940120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-49221951-2ff8-4a4f-9808-30ae92079a13 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '.version_select at 0x7fbadb1c1e50>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:32.960975 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-49221951-2ff8-4a4f-9808-30ae92079a13 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940098667" status: 202 len: 0 microversion: 2.1 time: 0.024751 Sep 26 10:36:32.961548 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 241/507] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 10:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940098667 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:36:33.137842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:33.139915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:33.147601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.148185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.148617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.149322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.149779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.150234 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.282628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:33.291262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:33.292733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:33.293897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a6b7a066-cb56-4bdb-90ed-a802c295373a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.160242 Sep 26 10:36:33.294517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 267/508] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:33 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:33.600772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:33.601382 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:33.609274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.609761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.610256 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.610954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.611410 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.611834 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.658856 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:33.659353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:33.665401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.665900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.666377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.667074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.667525 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.667949 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.749212 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:33.753661 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lazy-loading 'services' on Instance uuid bbcde70f-d1b6-40ce-8bcd-d17b1986f320 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:36:33.757907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e5784fec-c928-4325-acb2-ee3131811f78 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.161010 Sep 26 10:36:33.758982 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 242/509] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:33 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:33.829579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-808dd664-4522-462d-997d-b4eae06e6ad0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments/f2a3775a-385c-4759-8ee1-cbdc8413a7f9" status: 202 len: 0 microversion: 2.1 time: 0.174448 Sep 26 10:36:33.830184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 268/510] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:36:33 2022] DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments/f2a3775a-385c-4759-8ee1-cbdc8413a7f9 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 26 10:36:33.838691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:33.840874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:33.846897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.847384 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.847821 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.848517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:33.848963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:33.849383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:33.852029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:33.882503 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d3c713f4-1589-47fc-9f8a-6474e5845c73 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047739 Sep 26 10:36:33.883065 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 243/511] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:36:33 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:34.320971 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:34.321676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:34.328420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:34.328888 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:34.329328 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:34.330040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:34.330509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:34.330949 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:34.463038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:34.472121 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:34.473581 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:34.474778 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-873f123c-d97c-4a8d-8e7d-4499e59a8a9c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.158656 Sep 26 10:36:34.475334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 269/512] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:34 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:34.781934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:34.782608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:34.788932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:34.789407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:34.789838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:34.790552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:34.791005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:34.791436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:34.895818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:34.898049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:34.903852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:34.904329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:34.904793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:34.905475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:34.905924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:34.906367 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:34.922156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:34.929782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f1fd590f-f3c9-48b0-9e34-eeb912e101df tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.151689 Sep 26 10:36:34.930379 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 244/513] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:34 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:34.935398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b74b66e7-5722-480d-9e51-37266ff6a2ee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Sep 26 10:36:34.936487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 270/514] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:36:34 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:36:35.500431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:35.500954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:35.502809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:35.507858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:35.508337 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:35.508762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:35.509437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:35.509883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:35.510326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:35.639865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:35.648266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:35.649696 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:35.650851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3ab9933e-e30a-49fb-aab8-b14c0c125d8a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.154404 Sep 26 10:36:35.651399 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 245/515] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:35 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:35.948407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:35.950695 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:35.953286 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:35.953904 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:35.957723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:35.958241 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:35.958681 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:35.959376 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:35.959828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:35.960184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:35.960304 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:35.960670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:35.961134 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:35.961825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:35.962309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:35.962732 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:35.990189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-51f824ea-bb51-48eb-8440-f435e54f1cb1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Sep 26 10:36:35.990751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 271/516] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:36:35 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:36.096272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:36.104027 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-911c2110-c441-4bba-b140-5072a3846117 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.155091 Sep 26 10:36:36.104582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 246/517] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:35 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:36.677209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:36.677818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:36.683710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:36.684189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:36.684626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:36.685305 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:36.685753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:36.686779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:36.817634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:36.826300 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:36.828052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:36.829213 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a7652f0d-f31b-492c-aa45-f15bfd14c588 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.155933 Sep 26 10:36:36.829774 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 272/518] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:36 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:36.833144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:36.835437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:36.841233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:36.841709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:36.842225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:36.842907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:36.843350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:36.843767 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:36.866606 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'flavor' on Instance uuid 31c4900f-d778-4d9f-98f5-2657ff241a0e {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:36:36.993165 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bad8819b-7989-4287-ab85-db747c86656f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/action" status: 200 len: 32 microversion: 2.1 time: 0.163641 Sep 26 10:36:36.993791 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 247/519] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:36:36 2022] POST /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 10:36:37.003148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:37.003708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:37.004468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:37.006349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:37.011359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.011895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.012327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.013027 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.013160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.013473 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.013832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.013949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.014655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.015447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.015998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.016521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.053119 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-822d0ff6-7ce9-4eff-a771-49ac5b4d3f6d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054766 Sep 26 10:36:37.053979 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 273/520] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:36:36 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:37.127271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:37.127857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:37.133769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.134371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.134810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.135833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.136431 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.136915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.282221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:37.292395 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-74db02e4-6d62-493c-b492-3cc3defd42ee tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.292902 Sep 26 10:36:37.302078 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 248/521] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:36 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:37.359126 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:37.366836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a5b6ea11-59e5-4d4e-ae25-55a753ba5f0e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.243595 Sep 26 10:36:37.367411 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 274/522] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:37 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:37.854894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:37.855582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:37.861612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.862195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.862689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.863434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:37.863966 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:37.864438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:37.993684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:38.002703 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:38.004147 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:38.005277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-64d8bdf1-7bcb-4689-9cd7-3003b2f79683 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.154527 Sep 26 10:36:38.005826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 249/523] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:37 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:38.066267 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:38.068520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:38.075089 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.075571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.076004 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.076691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.077144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.077567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.107353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-848f95a5-6b7f-40ba-970f-4fbb68f3099d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044985 Sep 26 10:36:38.108322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 275/524] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:36:38 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:36:38.172124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:38.172631 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:38.178687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.179247 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.179770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.180561 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.181113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.181639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.206871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:36:38.282766 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f75941c9-a849-49af-bcce-65fea19dd7a4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 204 len: 0 microversion: 2.1 time: 0.114555 Sep 26 10:36:38.283639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 250/525] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:36:38 2022] DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:36:38.291889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:38.293103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:38.299598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.300311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.300753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.301444 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.301898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.302359 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.318601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:38.319292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:38.325043 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.325503 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.325930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.326720 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.327167 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.327589 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.493460 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:38.501609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ca2d598b-d60d-4fd5-b6a6-53d7e3858931 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1682 microversion: 2.1 time: 0.213464 Sep 26 10:36:38.502223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 276/526] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:38 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:38.504982 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:38.506691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:38.507549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:38.513314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b1b8af32-e7d3-48de-b70e-2380a2cbe93f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.199016 Sep 26 10:36:38.513456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.513801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.514574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 251/527] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:38 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:38.514746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.515634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:38.516411 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:38.517516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:38.534480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:38.651496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:38.659686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a250da50-3ddc-404f-bdfa-ff4231587268 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.156452 Sep 26 10:36:38.660195 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 277/528] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:38 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:39.031650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:39.032252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:39.038768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.039245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.039674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.040350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.040823 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.041241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.167648 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:39.176259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:39.177690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:39.178851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f6fa7904-4771-4daa-ab75-753927bc5627 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.151663 Sep 26 10:36:39.179398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 252/529] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:39 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:39.525566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:39.526240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:39.532786 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.533269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.533705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.534499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.534959 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.535384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.539550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:39.540164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:39.546567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.547050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.547486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.548168 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.548618 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.549039 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.732646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:39.741051 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9818cb1b-8f64-47cd-a9f3-4c791503c5f8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1682 microversion: 2.1 time: 0.219874 Sep 26 10:36:39.742415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 278/530] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:39 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:39.745472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:39.747527 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:39.748244 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:39.756359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4fc02354-b681-4474-902a-a35d18874625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.219761 Sep 26 10:36:39.756576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.757166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.758848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.759656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.760215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.760746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.763471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 253/531] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:39 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:39.855387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-e5dfe7b2-9734-4160-92c0-bb533c8cf168 req-9e0da11f-e6f7-4d1d-b30b-1b4874a58a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "name": "network-vif-plugged", "status": "completed", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:39.866301 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e5dfe7b2-9734-4160-92c0-bb533c8cf168 req-9e0da11f-e6f7-4d1d-b30b-1b4874a58a6c service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:39.866763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e5dfe7b2-9734-4160-92c0-bb533c8cf168 req-9e0da11f-e6f7-4d1d-b30b-1b4874a58a6c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:39.867132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e5dfe7b2-9734-4160-92c0-bb533c8cf168 req-9e0da11f-e6f7-4d1d-b30b-1b4874a58a6c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:39.883836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-e5dfe7b2-9734-4160-92c0-bb533c8cf168 req-9e0da11f-e6f7-4d1d-b30b-1b4874a58a6c service nova] Creating event network-vif-plugged:80a6fd45-6996-4b15-93f6-3122e122a647 for instance 05d17109-d4ce-4939-89c1-efb485f67ada on hv-cinder-84456 Sep 26 10:36:39.890623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-e5dfe7b2-9734-4160-92c0-bb533c8cf168 req-9e0da11f-e6f7-4d1d-b30b-1b4874a58a6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038757 Sep 26 10:36:39.892111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 254/532] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:36:39.896176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:39.905864 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b5e59bb0-d43a-4ce1-9b43-0c0e60bb7d65 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.162357 Sep 26 10:36:39.906700 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 279/533] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:39 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:40.205716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:40.206371 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:40.212513 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:40.212991 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:40.213414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:40.214122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:40.214569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:40.214983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:40.395665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:40.404329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:40.406459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:40.407620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-439e8f5e-0a0f-455a-b767-e70d9f2675de tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.206645 Sep 26 10:36:40.408176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 255/534] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:40 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:40.766107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:40.766727 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:40.773086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:40.773568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:40.774007 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:40.774803 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:40.775264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:40.775981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:40.780631 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:40.781238 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:40.787055 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:40.787617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:40.788111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:40.788805 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:40.789253 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:40.789670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:41.043091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:41.050541 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:41.052470 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3ac30327-3126-41d1-8103-3c837a431539 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1682 microversion: 2.1 time: 0.290883 Sep 26 10:36:41.066081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 280/535] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:40 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:41.066081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:41.066362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:41.066447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:41.066532 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-36b9dcf6-a742-465b-a614-25b13895c998 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.284127 Sep 26 10:36:41.066532 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 256/536] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:40 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:41.066686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:41.066686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:41.066686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:41.066686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:41.067006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:41.067590 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:41.272487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:41.281915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e5ba6a44-d9a4-46c1-857d-103fe556eca1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1678 microversion: 2.1 time: 0.227525 Sep 26 10:36:41.282548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 281/537] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:41 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:41.434382 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:41.435014 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:41.443836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:41.445745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:41.445745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:41.445745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:41.448155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:41.448605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:41.718178 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-a0d17110-c0fb-4a8b-8dac-8fc239b2b620 req-cc30ffdd-9e59-450c-86e9-67b2dd116f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbcde70f-d1b6-40ce-8bcd-d17b1986f320", "name": "network-vif-deleted", "tag": "75ba1d3d-2195-4f53-bc3d-9641a06aa644"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:41.728276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a0d17110-c0fb-4a8b-8dac-8fc239b2b620 req-cc30ffdd-9e59-450c-86e9-67b2dd116f40 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:41.729049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a0d17110-c0fb-4a8b-8dac-8fc239b2b620 req-cc30ffdd-9e59-450c-86e9-67b2dd116f40 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:41.729684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a0d17110-c0fb-4a8b-8dac-8fc239b2b620 req-cc30ffdd-9e59-450c-86e9-67b2dd116f40 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:41.747769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-a0d17110-c0fb-4a8b-8dac-8fc239b2b620 req-cc30ffdd-9e59-450c-86e9-67b2dd116f40 service nova] Creating event network-vif-deleted:75ba1d3d-2195-4f53-bc3d-9641a06aa644 for instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 on hv-cinder-84456 Sep 26 10:36:41.754147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-a0d17110-c0fb-4a8b-8dac-8fc239b2b620 req-cc30ffdd-9e59-450c-86e9-67b2dd116f40 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039606 Sep 26 10:36:41.755073 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 282/538] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:36:41.786739 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:41.809925 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:41.812004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:41.813192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7e0ef869-8522-4ff1-9c44-cb1d128cc6bd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1810 microversion: 2.20 time: 0.383330 Sep 26 10:36:41.813755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 257/539] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:41 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1810 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:42.080094 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:42.081705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:42.085059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:42.086281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:42.091203 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.091928 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.092684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.094099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.094750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.095249 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.096175 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.096837 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.097684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.098636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.099290 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.099872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.141341 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.142046 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.142696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.143297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lazy-loading 'fault' on Instance uuid bbcde70f-d1b6-40ce-8bcd-d17b1986f320 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:36:42.214067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:42.224041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d1740154-2c4f-43fd-9484-41a70e11f0af tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 200 len: 1332 microversion: 2.1 time: 0.148547 Sep 26 10:36:42.225275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 283/540] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:42 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:42.302825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:42.307003 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:42.307519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:42.311709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8dbe8793-f80b-4e74-8434-11da17182dd6 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.230575 Sep 26 10:36:42.312592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 258/541] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:42 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:42.315545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.316107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.316549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.317283 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.317745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.318188 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.583846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:42.593363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-10257bd9-9dc1-4020-8a2a-137b914436d0 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1655 microversion: 2.1 time: 0.290103 Sep 26 10:36:42.593943 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 284/542] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:42 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1655 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:42.616083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a1ec3f7c-cd8d-4bea-98b8-402c12676b8b tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:42.622563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f7c-cd8d-4bea-98b8-402c12676b8b tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.623052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f7c-cd8d-4bea-98b8-402c12676b8b tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.624010 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a1ec3f7c-cd8d-4bea-98b8-402c12676b8b tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.649227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a1ec3f7c-cd8d-4bea-98b8-402c12676b8b tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Going to try to start instance {{(pid=127055) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 26 10:36:42.722760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a1ec3f7c-cd8d-4bea-98b8-402c12676b8b tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action" status: 202 len: 0 microversion: 2.1 time: 0.108156 Sep 26 10:36:42.723401 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 259/543] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:36:42 2022] POST /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:36:42.731974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:42.732728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:42.739565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.740102 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.740739 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.741734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.742445 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.742873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.848582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:42.849556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:42.856866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.857357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.857860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.858843 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:42.859305 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:42.859733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:42.883758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:42.892447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8abbc1ed-ec23-4fb2-a78e-4b0f206573ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1664 microversion: 2.1 time: 0.164632 Sep 26 10:36:42.893027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 285/544] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:42 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:42.990150 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:42.999608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:43.001046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:43.002219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6e76e2f5-2c35-4120-a0c0-111c475769c0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1797 microversion: 2.20 time: 0.158329 Sep 26 10:36:43.002781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 260/545] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:36:42 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1797 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:36:43.249187 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:43.249795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:43.255665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.256155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.256592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.257281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.257735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.258189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.272284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 HTTP/1.1 Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:36:43.273921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:36:43.275529 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': 'bbcde70f-d1b6-40ce-8bcd-d17b1986f320'} Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:36:43.276316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:36:43.277550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:36:43.279368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:36:43.279368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ffa4a29a-b0b1-4dea-bf87-ae60b35e17ac tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 404 len: 111 microversion: 2.1 time: 0.030728 Sep 26 10:36:43.279697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 286/546] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:43 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:36:43.284579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-adc36bc8-70c5-481d-91c5-3c42e12fdc72 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '.version_select at 0x7fbadb1c13a0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:43.304312 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-adc36bc8-70c5-481d-91c5-3c42e12fdc72 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112293931" status: 202 len: 0 microversion: 2.1 time: 0.022772 Sep 26 10:36:43.304977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 261/547] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 10:36:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112293931 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:36:43.336333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:43.337371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:43.344801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.345515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.345975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.346721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.347265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.347699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.517282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:43.526275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d4ee9bc2-8b7c-4f7a-920e-c6b17f1c763e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.194020 Sep 26 10:36:43.526962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 287/548] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:43 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:43.865863 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:43.868044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:43.874974 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.875705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.876318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.877177 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.877796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.878291 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.917472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:43.918421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:43.925409 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.926066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.926371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.927076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:43.927535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:43.928314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:43.984422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1dcf5e5a-6dd3-4b96-838f-f4893e6834a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/action" status: 202 len: 0 microversion: 2.1 time: 0.122935 Sep 26 10:36:43.985075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 262/549] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:36:43 2022] POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:36:43.991156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cf597f89-9ee2-4903-bda8-754b458092d6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: .version_select at 0x7fbadb1c1820>, body: {"keypair": {"name": "tempest-keypair-415430982", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg/v0QzSx4GYp7iPiqW8z9pqy8R42YiWcK/ua3++Q2MRcN4n8FpLZOfaccibEsGCefPO+srFXKklO414fFIR7dRS9d8RQ+2tPeP46cHIzzMT2B1bBn4BHXo9M/CVj14FQ=="}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:44.007942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-cf597f89-9ee2-4903-bda8-754b458092d6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:36:44.012009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-cf597f89-9ee2-4903-bda8-754b458092d6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:36:44.042504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cf597f89-9ee2-4903-bda8-754b458092d6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055233 Sep 26 10:36:44.046162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 263/550] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:36:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:44.056571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:44.057876 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:44.065745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:44.066393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:44.066841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:44.067544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:44.068005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:44.068431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:44.205843 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:44.218423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b4e0c884-008c-4980-b356-b8664daa4316 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1664 microversion: 2.1 time: 0.304978 Sep 26 10:36:44.221346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 288/551] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:43 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1664 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:44.267349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:44.275649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-eb72680d-965d-4dac-979e-f76139c39b9d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1752 microversion: 2.1 time: 0.227698 Sep 26 10:36:44.276220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 264/552] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:44 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1752 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:44.550865 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:44.552147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:44.560272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:44.561301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:44.561742 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:44.562476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:44.563105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:44.563696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:44.750184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:44.758892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0cd4e978-9970-46b1-8399-2161c2b15e7f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.213589 Sep 26 10:36:44.759688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 289/553] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:44 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:45.243009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:45.243530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:45.249927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:45.250440 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:45.250867 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:45.251549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:45.251998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:45.252414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:45.301262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:45.301993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:45.308794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:45.309398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:45.309913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:45.310822 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:45.311353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:45.311860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:45.460517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:45.472431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-153eca8f-03f3-4c3b-a06a-3c830c7c47a2 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1668 microversion: 2.1 time: 0.233314 Sep 26 10:36:45.473478 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 265/554] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:45 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1668 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:45.508244 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:45.517554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-378a05a9-eac6-4b79-b568-b21174f504bd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1752 microversion: 2.1 time: 0.220155 Sep 26 10:36:45.518132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 290/555] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:45 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1752 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:45.783659 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:45.784369 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:45.790924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:45.791611 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:45.792233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:45.792925 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:45.793376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:45.793796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:45.942765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:45.945400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-633199412", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bfae35e-29c7-4379-ac17-c54030a00cba"}], "security_groups": [{"name": "tempest-securitygroup--1726257279"}], "key_name": "tempest-keypair-415430982", "user_data": "}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:45.950850 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f04671ca-cec2-4f88-b822-a20529cffbad tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.171487 Sep 26 10:36:45.952057 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 266/556] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:45 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:46.047225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] validate_networks() for [('5bfae35e-29c7-4379-ac17-c54030a00cba', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:36:46.416092 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:36:46.416518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:36:46.417021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:36:46.417432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:36:46.417842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:36:46.427151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:46.427633 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:46.428074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:46.428830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:46.429290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:46.429717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:46.446532 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:36:46.450495 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:36:46.465805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:36:46.468210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:36:46.514441 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-56952d1d-b557-4f63-a898-0ce396bf0525 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573262 Sep 26 10:36:46.515087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 291/557] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:36:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 10:36:46.526143 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f91b6991-96f4-439e-b01e-72bdbcedc820 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:46.526783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f91b6991-96f4-439e-b01e-72bdbcedc820 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:46.543093 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:46.544481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:46.550987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:46.551467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:46.551899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:46.552662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:46.553107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:46.553521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:46.585120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f91b6991-96f4-439e-b01e-72bdbcedc820 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:46.593731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f91b6991-96f4-439e-b01e-72bdbcedc820 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1240 microversion: 2.1 time: 0.071487 Sep 26 10:36:46.594338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 267/558] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:46 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:46.702526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:46.710728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fcceb3f7-ef9e-4d6a-a18e-0a6b132db332 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.171576 Sep 26 10:36:46.714330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 292/559] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:46 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:46.975975 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:46.976585 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:46.983291 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:46.983779 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:46.984213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:46.984903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:46.985359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:46.985784 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:47.123220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:47.133749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-31f82844-da63-4238-a90c-5c131b8adc52 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.161400 Sep 26 10:36:47.134426 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 268/560] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:46 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:47.616737 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:47.617257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:47.624024 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:47.624520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:47.625293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:47.625647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:47.626137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:47.626573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:47.690844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:47.700401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-dc54c84c-58ba-441d-9156-ec9bf9200f92 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1292 microversion: 2.1 time: 0.087509 Sep 26 10:36:47.700978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 293/561] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:47 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:47.735267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:47.735880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:47.743718 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:47.745128 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:47.745604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:47.746530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:47.746949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:47.747384 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:47.913971 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:47.922587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e0470f4a-01f1-4586-bf64-4c7ab3205142 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.191735 Sep 26 10:36:47.923149 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 269/562] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:47 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:48.158540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:48.159237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:48.165380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:48.165858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:48.166322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:48.167010 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:48.167461 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:48.167880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:48.297870 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:48.305955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-86e5baa6-b3ad-4662-9149-e77fe9e7917f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.151288 Sep 26 10:36:48.306775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 294/563] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:48 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:48.724668 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:48.725313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:48.731693 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:48.732127 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:48.732565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:48.733978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:48.734475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:48.734903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:48.872716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:48.880870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-04692aae-cce1-46df-852c-c764a8b3112e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.160347 Sep 26 10:36:48.881446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 270/564] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:48 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:36:48.947599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:48.948137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:48.950759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:48.956124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:48.956615 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:48.957054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:48.957755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:48.958275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:48.958784 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:49.108299 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:49.111169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:49.118635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b9b0838b-603b-4b3f-97ef-2121bd596bb7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.175196 Sep 26 10:36:49.119213 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 295/565] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:48 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:49.220987 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-487f16b8-ee24-42ca-89a8-420b3648329e req-d9667ef3-7207-4fc1-9f05-0ef59c1eb626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32027e55-4845-402a-8c64-a0f4e072d638", "tag": "e017867e-26ce-4cd5-b184-7ac0182d7fb4"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:49.230733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-487f16b8-ee24-42ca-89a8-420b3648329e req-d9667ef3-7207-4fc1-9f05-0ef59c1eb626 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:49.231465 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-487f16b8-ee24-42ca-89a8-420b3648329e req-d9667ef3-7207-4fc1-9f05-0ef59c1eb626 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:49.232078 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-487f16b8-ee24-42ca-89a8-420b3648329e req-d9667ef3-7207-4fc1-9f05-0ef59c1eb626 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:49.244485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-487f16b8-ee24-42ca-89a8-420b3648329e req-d9667ef3-7207-4fc1-9f05-0ef59c1eb626 service nova] Creating event network-changed:e017867e-26ce-4cd5-b184-7ac0182d7fb4 for instance 32027e55-4845-402a-8c64-a0f4e072d638 on hv-cinder-84456 Sep 26 10:36:49.249457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-487f16b8-ee24-42ca-89a8-420b3648329e req-d9667ef3-7207-4fc1-9f05-0ef59c1eb626 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033034 Sep 26 10:36:49.250465 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 271/566] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:49.330654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:49.331269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:49.337320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:49.337809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:49.338283 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:49.338981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:49.339441 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:49.339878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:49.469401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:49.477882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7195f8d0-3f10-4857-a9a9-476bce11e625 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.151662 Sep 26 10:36:49.478601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 296/567] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:49 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:49.904173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:49.904865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:49.911452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:49.911925 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:49.912354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:49.913029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:49.913472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:49.913889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:50.043677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:50.051601 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c27bc836-4e16-4cd4-a87d-8b4450f8510b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.152112 Sep 26 10:36:50.052155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 272/568] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:49 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:50.142118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:50.142674 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:50.149115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:50.149597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:50.150047 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:50.150743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:50.151197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:50.151624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:50.290972 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:50.299033 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f10ed8fb-d7d5-4332-864d-d5b2d9f186bf tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.160928 Sep 26 10:36:50.299598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 297/569] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:50 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:50.501906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:50.502455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:50.508416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:50.508898 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:50.509333 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:50.510015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:50.510495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:50.510916 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:50.640338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:50.648574 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d20c3f10-1861-4ed0-9a5a-e742d1654767 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.151014 Sep 26 10:36:50.649159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 273/570] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:50 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:51.074674 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:51.075289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:51.081182 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:51.081665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:51.082138 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:51.082828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:51.083282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:51.083707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:51.214569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:51.222730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b8e29c35-f70f-4216-abf4-901c5644ac32 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.151937 Sep 26 10:36:51.223300 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 298/571] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:51 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:51.321599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:51.322165 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:51.329060 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:51.329533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:51.329961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:51.330660 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:51.331106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:51.331521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:51.471286 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:51.479835 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1b6f47d7-92eb-4cd7-a763-c328d6b884b2 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.162100 Sep 26 10:36:51.480410 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 274/572] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:51 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:51.672969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:51.673584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:51.679530 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:51.680014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:51.680452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:51.681136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:51.681592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:51.682044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:51.819559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:51.827752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5153466e-55e8-47a4-9191-a0a1b9ea2cf3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.159203 Sep 26 10:36:51.828320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 299/573] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:51 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:52.246344 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:52.246879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:52.252938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:52.253419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:52.253855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:52.254570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:52.255027 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:52.255457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:52.258060 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:52.386771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:52.395385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d282250c-ad07-4b60-8c30-0cfc44e3ccc6 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.153171 Sep 26 10:36:52.395949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 275/574] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:52 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:52.503618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:52.504142 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:52.510658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:52.511143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:52.511579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:52.512264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:52.512718 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:52.513142 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:52.658656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:52.666880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3b86ad2d-8ba5-43b4-b021-18db5f2d4ee7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.167200 Sep 26 10:36:52.667448 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 300/575] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:52 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:52.850980 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:52.851587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:52.857778 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:52.858335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:52.858749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:52.859434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:52.859886 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:52.860310 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:52.991323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:53.000139 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7cbdfe0b-6b99-4a36-a573-c79d9bd9e6ba tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.153023 Sep 26 10:36:53.000706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 276/576] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:52 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:53.418846 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:53.419458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:53.425857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:53.426365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:53.426796 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:53.427472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:53.427927 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:53.428331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:53.555318 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:53.563426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-307e4cb4-fd54-41ce-9f32-d0012d775bbb tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.148558 Sep 26 10:36:53.564022 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 301/577] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:53 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:53.690127 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:53.690699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:53.696946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:53.697417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:53.697844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:53.698549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:53.698998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:53.699418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:53.849536 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:53.858163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fdf1ca8f-e8d9-40cc-b777-a75975b8a284 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.172300 Sep 26 10:36:53.859278 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 277/578] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:53 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:53.939321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-71fd42b6-0d4a-4e2c-bf72-2de602a1c207 req-4b984a7c-9039-4874-906f-d6be8a0eb413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32027e55-4845-402a-8c64-a0f4e072d638", "name": "network-vif-plugged", "status": "completed", "tag": "e017867e-26ce-4cd5-b184-7ac0182d7fb4"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:53.949363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-71fd42b6-0d4a-4e2c-bf72-2de602a1c207 req-4b984a7c-9039-4874-906f-d6be8a0eb413 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:53.949839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-71fd42b6-0d4a-4e2c-bf72-2de602a1c207 req-4b984a7c-9039-4874-906f-d6be8a0eb413 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:53.950292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-71fd42b6-0d4a-4e2c-bf72-2de602a1c207 req-4b984a7c-9039-4874-906f-d6be8a0eb413 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:53.962374 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-71fd42b6-0d4a-4e2c-bf72-2de602a1c207 req-4b984a7c-9039-4874-906f-d6be8a0eb413 service nova] Creating event network-vif-plugged:e017867e-26ce-4cd5-b184-7ac0182d7fb4 for instance 32027e55-4845-402a-8c64-a0f4e072d638 on hv-cinder-84456 Sep 26 10:36:53.968647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-71fd42b6-0d4a-4e2c-bf72-2de602a1c207 req-4b984a7c-9039-4874-906f-d6be8a0eb413 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032503 Sep 26 10:36:53.969254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 302/579] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:36:54.022816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:54.023528 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:54.032395 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:54.036070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:54.036650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:54.037650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:54.038407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:54.038874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:54.184683 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:54.192855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d106f8fa-6552-4da0-bae4-f5f17fc67224 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.173904 Sep 26 10:36:54.193423 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 278/580] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:54 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:54.587287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:54.588115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:54.595404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:54.595884 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:54.596317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:54.597002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:54.597452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:54.597870 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:54.726723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:54.734535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a28e9d5a-df9d-4d20-9abb-b0e5566659e8 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.151943 Sep 26 10:36:54.735103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 303/581] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:54 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:54.882593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:54.883136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:54.889459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:54.890632 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:54.891067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:54.891747 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:54.892197 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:54.892624 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:55.032969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:55.041251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1b117f9a-bd19-404b-a2f2-41cd41aaa8a7 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.162550 Sep 26 10:36:55.041809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 279/582] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:54 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:55.215835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:55.216366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:55.222323 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:55.222804 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:55.223235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:55.223915 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:55.224367 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:55.224790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:55.349977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:55.358298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cb60fd00-3a00-427e-85da-76845fe137da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.146343 Sep 26 10:36:55.359361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 304/583] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:55 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:55.756938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:55.757544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:55.763464 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:55.763942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:55.764374 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:55.765051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:55.765500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:55.765918 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:55.898297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:55.905817 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2c77f07c-0406-4fe5-9a32-1ac57bff27c0 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1366 microversion: 2.1 time: 0.152792 Sep 26 10:36:55.906658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 280/584] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:55 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:56.064126 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:56.064725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:56.071531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:56.072021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:56.072459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:56.073153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:56.073644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:56.074091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:56.223811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:56.232254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2f466fbe-2440-4063-b82f-df8093cf2998 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1757 microversion: 2.1 time: 0.172090 Sep 26 10:36:56.232813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 305/585] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:56 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:56.381536 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:56.382180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:56.387958 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:56.388438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:56.388865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:56.389541 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:56.390644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:56.391061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:56.523880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:56.532266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2a2d4e2e-5c96-422f-af6a-4d01154acf1b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.154511 Sep 26 10:36:56.532841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 281/586] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:56 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:56.928545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:56.929161 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:56.931174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:56.931837 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=6 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:56.938149 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:56.938637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:56.939073 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:56.939764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:56.940222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:56.940649 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.067068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:57.075301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7a270671-c4cf-4e71-8401-5dcc32d45279 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1557 microversion: 2.1 time: 0.150663 Sep 26 10:36:57.075978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 306/587] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:56 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:57.098804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:57.099295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:57.101191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:36:57.107484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:57.107963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:57.108496 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.109178 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:57.109622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:57.110058 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.185869 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2932673e-c28c-4083-848a-d583f8116f35 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090917 Sep 26 10:36:57.187083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 282/588] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:36:57 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:57.257358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:57.258619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:57.266054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:57.266543 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:57.267658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.268365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:57.268830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:57.269258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.521957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:57.530177 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8d2714f4-1cb7-4702-b173-d834e7b0c37e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1760 microversion: 2.1 time: 0.278424 Sep 26 10:36:57.530941 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 307/589] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:57 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1760 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:57.556079 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:57.556733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:57.563506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:57.564029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:57.564469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.565203 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:57.565656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:57.566124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:57.773964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:57.782126 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f1092fd1-8d8b-45e6-897f-59abdbedf07c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.229911 Sep 26 10:36:57.782709 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 283/590] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:57 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:58.502420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-b2a5bd65-f85b-4b6b-a2cb-c662051972ee req-875ae4de-2b54-42ce-99f9-f3438420aea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32027e55-4845-402a-8c64-a0f4e072d638", "tag": "e017867e-26ce-4cd5-b184-7ac0182d7fb4"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:36:58.512346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b2a5bd65-f85b-4b6b-a2cb-c662051972ee req-875ae4de-2b54-42ce-99f9-f3438420aea8 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:58.512827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b2a5bd65-f85b-4b6b-a2cb-c662051972ee req-875ae4de-2b54-42ce-99f9-f3438420aea8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:58.513264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-b2a5bd65-f85b-4b6b-a2cb-c662051972ee req-875ae4de-2b54-42ce-99f9-f3438420aea8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:58.525025 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-b2a5bd65-f85b-4b6b-a2cb-c662051972ee req-875ae4de-2b54-42ce-99f9-f3438420aea8 service nova] Creating event network-changed:e017867e-26ce-4cd5-b184-7ac0182d7fb4 for instance 32027e55-4845-402a-8c64-a0f4e072d638 on hv-cinder-84456 Sep 26 10:36:58.529878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-b2a5bd65-f85b-4b6b-a2cb-c662051972ee req-875ae4de-2b54-42ce-99f9-f3438420aea8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031787 Sep 26 10:36:58.531076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 308/591] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:36:58.805998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:58.806629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:58.813469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:58.813949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:58.814403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:58.815086 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:58.815530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:58.815950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:58.945376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:36:58.954443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4bd6a623-321d-47d8-bcf9-9faeba222242 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.152295 Sep 26 10:36:58.955016 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 284/592] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:58 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:36:59.978337 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:36:59.978965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:36:59.985958 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:59.986471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:59.986903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:36:59.987588 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:36:59.988035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:36:59.988458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:00.114361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:00.122389 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7b0be76a-482f-49f3-a083-89f570c9d77f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1735 microversion: 2.1 time: 0.148527 Sep 26 10:37:00.122947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 309/593] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:36:59 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:01.146932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:01.147522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:01.149943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:01.155817 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.156889 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.157033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.157711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.158204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.158628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.297274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:01.305324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3711d284-2db8-4e79-ab8f-74d8d4a8da86 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1715 microversion: 2.1 time: 0.162381 Sep 26 10:37:01.305883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 285/594] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:01 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1715 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:01.415393 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:01.416010 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:01.422513 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.423000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.423439 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.424133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.424591 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.425013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.504993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] HTTP exception thrown: Cannot 'detach_volume' instance 31c4900f-d778-4d9f-98f5-2657ff241a0e while it is in vm_state rescued Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Request method failure captured: Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments/5b034a4d-9ff5-4b95-b517-ea63127e283b HTTP/1.1 Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QRZkIEazrHPp-ASawOGwhHKFneNncuKdrdU4jdL9mPTE68D6RIU6Tfs4pCHVzucWAe0FQlnAR5WeU26ZPDFO5PP3iYiPVIqUBsIRXPpJ6UrsXcVIuEkaZWOrJHn_jdqIiga6LqGme456-g87uXjHzgMbC3qHWSOXVyGjEtwT1DcU Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:37:01.506626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_615e5825389c4f1d96e6398bf1dab735", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 5085a918c6b74488b3dd70c1fb257381 Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:37:01.508183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Cannot 'detach_volume' instance 31c4900f-d778-4d9f-98f5-2657ff241a0e while it is in vm_state rescued Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'server_id': '31c4900f-d778-4d9f-98f5-2657ff241a0e', 'id': '5b034a4d-9ff5-4b95-b517-ea63127e283b'} Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:37:01.508976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 31c4900f-d778-4d9f-98f5-2657ff241a0e while it is in vm_state rescued Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 31c4900f-d778-4d9f-98f5-2657ff241a0e while it is in vm_state rescued Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:01.510473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Returning 409 to user: Cannot 'detach_volume' instance 31c4900f-d778-4d9f-98f5-2657ff241a0e while it is in vm_state rescued {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:37:01.511608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3c26e082-9c9d-4ae3-b5e5-77c70ec4059f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments/5b034a4d-9ff5-4b95-b517-ea63127e283b" status: 409 len: 152 microversion: 2.1 time: 0.096692 Sep 26 10:37:01.511608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 310/595] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:37:01 2022] DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments/5b034a4d-9ff5-4b95-b517-ea63127e283b => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 26 10:37:01.517570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:01.518128 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:01.523922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.524407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.524823 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.525505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.525955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.526412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.591732 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b0506b32-a750-4ecc-a637-2edc8a2542de tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "POST /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.078274 Sep 26 10:37:01.592362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 286/596] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:37:01 2022] POST /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:37:01.600747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:01.601353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:01.607478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.607957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.608909 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.609670 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:01.610169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:01.610679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:01.739517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:01.747806 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-53a01bd3-b37f-4579-97d3-43dac8f8a879 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1723 microversion: 2.1 time: 0.151045 Sep 26 10:37:01.748371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 311/597] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:01 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:37:02.772365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:02.773056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:02.779137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:02.779637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:02.780067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:02.780743 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:02.781189 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:02.781604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:02.908812 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:02.916818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a5048e28-d643-4964-94d5-368e1d0a7d55 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1723 microversion: 2.1 time: 0.149234 Sep 26 10:37:02.917372 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 287/598] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:02 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:03.941353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:03.941868 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:03.948522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:03.949013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:03.949455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:03.950383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:03.950847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:03.951282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:04.084821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:04.093026 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-059414cf-2cc8-412c-890b-859d99a9a805 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1723 microversion: 2.1 time: 0.155590 Sep 26 10:37:04.093579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 312/599] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:03 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:05.116868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:05.117449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:05.123838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:05.124324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:05.124780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:05.125444 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:05.125899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:05.126357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:05.251024 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:05.258988 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-545d3d3b-7f8c-47cc-8001-06173d1bb433 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1729 microversion: 2.1 time: 0.146086 Sep 26 10:37:05.259552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 288/600] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:05 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:05.282535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:05.283058 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:05.289301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:05.289810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:05.290277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:05.290955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:05.291400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:05.291818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:05.370706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-97d2666a-ad6d-497e-9370-f8eb812fe0c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092568 Sep 26 10:37:05.371294 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 313/601] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:37:05 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:06.248610 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-6b7126c1-110f-417b-bd87-c27a21bc42fd req-e1b376ff-c864-4708-9b34-0140ec8c36db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c4900f-d778-4d9f-98f5-2657ff241a0e", "tag": "852a1cf1-997f-48f3-ba24-fee4c258bd27"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:06.261582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-6b7126c1-110f-417b-bd87-c27a21bc42fd req-e1b376ff-c864-4708-9b34-0140ec8c36db service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:06.262239 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-6b7126c1-110f-417b-bd87-c27a21bc42fd req-e1b376ff-c864-4708-9b34-0140ec8c36db service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:06.262688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-6b7126c1-110f-417b-bd87-c27a21bc42fd req-e1b376ff-c864-4708-9b34-0140ec8c36db service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:06.275677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-6b7126c1-110f-417b-bd87-c27a21bc42fd req-e1b376ff-c864-4708-9b34-0140ec8c36db service nova] Creating event network-changed:852a1cf1-997f-48f3-ba24-fee4c258bd27 for instance 31c4900f-d778-4d9f-98f5-2657ff241a0e on hv-cinder-84456 Sep 26 10:37:06.280910 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-6b7126c1-110f-417b-bd87-c27a21bc42fd req-e1b376ff-c864-4708-9b34-0140ec8c36db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035890 Sep 26 10:37:06.281527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 289/602] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:08.295998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-d8c62cf9-f86d-4783-a088-3dbe221d2ff6 req-6d246ff6-2390-4183-993d-8a17e5cc1eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c4900f-d778-4d9f-98f5-2657ff241a0e", "tag": "852a1cf1-997f-48f3-ba24-fee4c258bd27"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:08.305204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-d8c62cf9-f86d-4783-a088-3dbe221d2ff6 req-6d246ff6-2390-4183-993d-8a17e5cc1eb3 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:08.305679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-d8c62cf9-f86d-4783-a088-3dbe221d2ff6 req-6d246ff6-2390-4183-993d-8a17e5cc1eb3 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:08.306126 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-d8c62cf9-f86d-4783-a088-3dbe221d2ff6 req-6d246ff6-2390-4183-993d-8a17e5cc1eb3 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:08.308649 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:08.318312 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-d8c62cf9-f86d-4783-a088-3dbe221d2ff6 req-6d246ff6-2390-4183-993d-8a17e5cc1eb3 service nova] Creating event network-changed:852a1cf1-997f-48f3-ba24-fee4c258bd27 for instance 31c4900f-d778-4d9f-98f5-2657ff241a0e on hv-cinder-84456 Sep 26 10:37:08.323390 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-d8c62cf9-f86d-4783-a088-3dbe221d2ff6 req-6d246ff6-2390-4183-993d-8a17e5cc1eb3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031726 Sep 26 10:37:08.323975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 314/603] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:37:22.368394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=9 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:22.369048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:22.373359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:22.373939 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:22.381034 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:22.381510 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:22.381936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:22.382646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:22.383094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:22.383511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:22.415816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5c073e88-3fe1-461d-880e-9d19cb159c48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments/016e290a-16f6-4f86-b2de-b85feb476c15" status: 200 len: 194 microversion: 2.20 time: 0.049145 Sep 26 10:37:22.416392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 290/604] 10.222.0.49 () {60 vars in 1454 bytes} [Mon Sep 26 10:37:22 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments/016e290a-16f6-4f86-b2de-b85feb476c15 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:37:22.483324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:22.483913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:22.486211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=39 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:22.486859 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:22.493469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:22.493960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:22.494442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:22.495141 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:22.495598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:22.496028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:22.575177 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lazy-loading 'services' on Instance uuid 05d17109-d4ce-4939-89c1-efb485f67ada {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:37:22.654296 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-26abcb38-661b-444a-9644-3c15e817de0c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments/016e290a-16f6-4f86-b2de-b85feb476c15" status: 202 len: 0 microversion: 2.20 time: 0.175018 Sep 26 10:37:22.655053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 315/605] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Sep 26 10:37:22 2022] DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments/016e290a-16f6-4f86-b2de-b85feb476c15 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:37:22.666295 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:22.669662 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:22.677677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:22.678898 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:22.679446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:22.680404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:22.682154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:22.682789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:22.723065 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a85fb3e0-5b3e-44f6-a651-e56bd007251b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063293 Sep 26 10:37:22.723623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 291/606] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 10:37:22 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:37:23.736910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:23.739260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:23.745384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:23.745868 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:23.746334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:23.747020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:23.747471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:23.747894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:23.776452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b7cb3338-72ff-466b-bab0-89b6298c5de6 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044347 Sep 26 10:37:23.777006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 316/607] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 10:37:23 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:23.840430 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:23.841052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:23.847151 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:23.847626 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:23.848062 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:23.848741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:23.849242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:23.849663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:23.874854 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:37:23.947816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b5987e43-9a58-455f-8b98-bcfa4672abcd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 204 len: 0 microversion: 2.20 time: 0.110992 Sep 26 10:37:23.948622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 292/608] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 10:37:23 2022] DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 10:37:23.956820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:23.957597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:23.965361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:23.965910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:23.966395 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:23.967093 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:23.967545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:23.968407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:24.101353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:24.110673 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:24.112146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:24.113308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cdd3cd44-18ef-4112-85a5-265b6ac252ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.160399 Sep 26 10:37:24.113877 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 317/609] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:23 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:25.140427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:25.141033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:25.147896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:25.148382 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:25.148826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:25.149517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:25.149975 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:25.150426 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:25.283328 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:25.292019 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:25.293464 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:25.294642 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-95908b2c-e2a5-44bf-b2ca-6b15fbdd2706 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.158640 Sep 26 10:37:25.295199 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 293/610] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:25 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:26.319356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:26.320096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:26.326800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:26.327349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:26.327736 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:26.328445 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:26.328908 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:26.329338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:26.464778 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:26.473107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:26.474740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:26.475936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-321c20bb-1b09-4fb3-9dab-233f4fdbe61d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1725 microversion: 2.20 time: 0.160496 Sep 26 10:37:26.476496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 318/611] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:26 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:27.155972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-caef6193-3d0f-4302-a518-c2a48c8809b6 req-45f10efb-8d65-4c11-9fd2-c4f0c8fd5a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05d17109-d4ce-4939-89c1-efb485f67ada", "name": "network-vif-deleted", "tag": "80a6fd45-6996-4b15-93f6-3122e122a647"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:27.166615 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-caef6193-3d0f-4302-a518-c2a48c8809b6 req-45f10efb-8d65-4c11-9fd2-c4f0c8fd5a8e service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:27.167129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-caef6193-3d0f-4302-a518-c2a48c8809b6 req-45f10efb-8d65-4c11-9fd2-c4f0c8fd5a8e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:27.167534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-caef6193-3d0f-4302-a518-c2a48c8809b6 req-45f10efb-8d65-4c11-9fd2-c4f0c8fd5a8e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:27.179646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-caef6193-3d0f-4302-a518-c2a48c8809b6 req-45f10efb-8d65-4c11-9fd2-c4f0c8fd5a8e service nova] Creating event network-vif-deleted:80a6fd45-6996-4b15-93f6-3122e122a647 for instance 05d17109-d4ce-4939-89c1-efb485f67ada on hv-cinder-84456 Sep 26 10:37:27.184645 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-caef6193-3d0f-4302-a518-c2a48c8809b6 req-45f10efb-8d65-4c11-9fd2-c4f0c8fd5a8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032187 Sep 26 10:37:27.186216 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 294/612] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:27.501983 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:27.502623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:27.508935 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:27.509417 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:27.509854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:27.510578 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:27.511145 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:27.511764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:27.545676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:27.546221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:27.546663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:27.547109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lazy-loading 'fault' on Instance uuid 05d17109-d4ce-4939-89c1-efb485f67ada {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:37:27.587345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:27.596132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:27.597595 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:27.599371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0ba255af-a8bf-4342-83c6-c8a3913484d3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 200 len: 1372 microversion: 2.20 time: 0.100979 Sep 26 10:37:27.599962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 319/613] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:27 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:28.625727 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:28.626452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:28.633083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.633575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.634002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.634716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.635164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.635587 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.649269 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] HTTP exception thrown: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Request method failure captured: Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada HTTP/1.1 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYArjrx41rH6_oHblj6RIzI-OHxPlwHNIDY89If8YuLYnBoOj5dbMYboxjNYmwmHngAHAmfbqLy2kEE-Fgf7iFj2d-lhlWYgjybLwjxY6Fd7LYN3k4ty9Ik9woQxVbA9w7hGNq5AcaVQvS8lZd8E4WL3NJV0F2zq_tLkoAu-cX7Lvto Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:37:28.650948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38cccae871b94a9db82b5017c2c497c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 8c8ebfdad6ab437eb7dda111fee84205 Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:37:28.652485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '05d17109-d4ce-4939-89c1-efb485f67ada'} Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:37:28.653276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:37:28.654599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:28.655723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Returning 404 to user: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:37:28.655723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-68240bfe-f818-4fe1-afb7-ffc12017643d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 404 len: 111 microversion: 2.20 time: 0.031289 Sep 26 10:37:28.655723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 295/614] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:28 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 26 10:37:28.661410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-de97bf5d-103e-4f85-83ec-ed96334fd6b1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '.version_select at 0x7fbadb1b49d0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:28.662224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:28.664334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:28.670445 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.670932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.671365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.672053 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.672502 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.672923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.681068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-de97bf5d-103e-4f85-83ec-ed96334fd6b1 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684589492" status: 204 len: 0 microversion: 2.20 time: 0.023515 Sep 26 10:37:28.681655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 320/615] 10.222.0.49 () {60 vars in 1262 bytes} [Mon Sep 26 10:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1684589492 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 10:37:28.704724 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ff743698-66d2-40a9-9437-3cdae4a24c33 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046042 Sep 26 10:37:28.705288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 296/616] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:28 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 26 10:37:28.771587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:28.772086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:28.778699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.779191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.779628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.780328 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.780781 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.781205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.806607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:37:28.893997 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e1c84930-e9ca-41fe-a72e-73df2d779560 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 204 len: 0 microversion: 2.1 time: 0.126608 Sep 26 10:37:28.901930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 321/617] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:37:28 2022] DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:37:28.916700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:28.917326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:28.928006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.928556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.929028 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:28.929745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:28.930244 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:28.930708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:29.064616 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:29.072957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5c991fd0-7b30-4c91-ac57-7dc9fa30f139 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1674 microversion: 2.1 time: 0.164305 Sep 26 10:37:29.073530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 297/618] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:28 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:29.354201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cb1e66c2-0254-481c-8e22-58d5a5870c15 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'create', calling method: .version_select at 0x7fbadb1e88b0>, body: {"keypair": {"name": "tempest-keypair-943532567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhChh0u2CxuFUaVIzNgyQklthec/tZ4mNCpDmniZhorb6FU71ayEaYWFo5Y6Uk7dLeSQStkKV9AUYWSwwma8eFctHnwx/M0+EjFQd5kQJTSBZfd0sWBt5hliWz553zX5g=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:29.369988 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-cb1e66c2-0254-481c-8e22-58d5a5870c15 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for project 38cccae871b94a9db82b5017c2c497c1. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:37:29.373773 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-cb1e66c2-0254-481c-8e22-58d5a5870c15 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for user 8c8ebfdad6ab437eb7dda111fee84205 and project 38cccae871b94a9db82b5017c2c497c1. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:37:29.395242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cb1e66c2-0254-481c-8e22-58d5a5870c15 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046095 Sep 26 10:37:29.395871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 322/619] 10.222.0.49 () {62 vars in 1200 bytes} [Mon Sep 26 10:37:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 26 10:37:30.096229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:30.096864 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:30.104246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:30.104724 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:30.105156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:30.105840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:30.106311 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:30.106731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:30.326662 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:30.334847 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-dce0ec2c-ec0a-4d4c-9228-6d6308075fab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1674 microversion: 2.1 time: 0.242521 Sep 26 10:37:30.335418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 298/620] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:30 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1674 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:30.761713 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1830651597", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "154a4e25-766b-4e4b-9202-0213b7789f71"}], "security_groups": [{"name": "tempest-securitygroup--1440694991"}], "key_name": "tempest-keypair-943532567", "user_data": "}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:30.865362 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] validate_networks() for [('154a4e25-766b-4e4b-9202-0213b7789f71', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:37:31.232363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:37:31.232790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:37:31.233266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:37:31.233676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:37:31.234123 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:37:31.244532 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:31.245021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:31.245458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:31.246401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:31.246858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:31.247288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:31.266570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for project 38cccae871b94a9db82b5017c2c497c1. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:37:31.270467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Getting quotas for user 8c8ebfdad6ab437eb7dda111fee84205 and project 38cccae871b94a9db82b5017c2c497c1. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:37:31.281291 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:37:31.283727 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:37:31.331678 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-af1e6a4c-34e0-4d21-a23d-5311a3d06c50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.576366 Sep 26 10:37:31.332346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 323/621] 10.222.0.49 () {62 vars in 1188 bytes} [Mon Sep 26 10:37:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 26 10:37:31.343713 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1fc4f9e5-c3e1-4f81-afbc-865413d20301 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:31.344506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1fc4f9e5-c3e1-4f81-afbc-865413d20301 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:31.359976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:31.360683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:31.368139 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:31.369071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:31.369523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:31.370267 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:31.370734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:31.371164 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:31.410624 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1fc4f9e5-c3e1-4f81-afbc-865413d20301 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:31.418275 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1fc4f9e5-c3e1-4f81-afbc-865413d20301 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:31.419743 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1fc4f9e5-c3e1-4f81-afbc-865413d20301 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:31.421051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1fc4f9e5-c3e1-4f81-afbc-865413d20301 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1281 microversion: 2.20 time: 0.081402 Sep 26 10:37:31.421808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 299/622] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:31 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:31.787286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:31.795485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-51c20317-d85f-4a42-9a20-a5664058bb42 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1674 microversion: 2.1 time: 0.439537 Sep 26 10:37:31.796664 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 324/623] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:31 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1674 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:32.237497 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-7e4f3773-73d0-4776-9acf-bf97b71c18d4 req-d7a7773d-60c4-4067-8317-8f7fe2c6a008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ca6fe02-8975-4daa-a713-5ec2520b2d67", "name": "network-vif-deleted", "tag": "798a1629-515e-41fd-8c26-34ded4b3db4d"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:32.250287 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-7e4f3773-73d0-4776-9acf-bf97b71c18d4 req-d7a7773d-60c4-4067-8317-8f7fe2c6a008 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:32.251191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-7e4f3773-73d0-4776-9acf-bf97b71c18d4 req-d7a7773d-60c4-4067-8317-8f7fe2c6a008 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:32.251758 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-7e4f3773-73d0-4776-9acf-bf97b71c18d4 req-d7a7773d-60c4-4067-8317-8f7fe2c6a008 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:32.274008 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-7e4f3773-73d0-4776-9acf-bf97b71c18d4 req-d7a7773d-60c4-4067-8317-8f7fe2c6a008 service nova] Creating event network-vif-deleted:798a1629-515e-41fd-8c26-34ded4b3db4d for instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 on hv-cinder-84456 Sep 26 10:37:32.279631 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-7e4f3773-73d0-4776-9acf-bf97b71c18d4 req-d7a7773d-60c4-4067-8317-8f7fe2c6a008 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045470 Sep 26 10:37:32.281066 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 300/624] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:32.447377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:32.447997 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:32.453757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:32.454270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:32.454743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:32.455437 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:32.455893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:32.456509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:32.706607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:32.737002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:32.740968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:32.743052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c32d4a99-bb34-4707-add4-0dfc3d71b034 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1333 microversion: 2.20 time: 0.299562 Sep 26 10:37:32.746598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 325/625] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:32 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1333 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:32.825700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:32.827330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:32.837122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:32.837612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:32.838063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:32.840441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:32.840901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:32.841729 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:32.879131 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:32.879825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:32.881543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:32.882176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lazy-loading 'fault' on Instance uuid 9ca6fe02-8975-4daa-a713-5ec2520b2d67 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:37:32.979385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:32.992387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ef3940df-284d-4ef3-8e19-2c212492bdd1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 200 len: 1327 microversion: 2.1 time: 0.172728 Sep 26 10:37:32.994417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 301/626] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:32 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:33.773614 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:33.774909 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:33.781402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:33.781894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:33.782382 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:33.783130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:33.783622 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:33.784083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:33.921963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:33.930243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:33.931592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:33.932695 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b9500174-d63f-4aba-ac15-135129fb17f3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.163698 Sep 26 10:37:33.933447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 326/627] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:33 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:34.016458 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:34.017183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:34.024122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:34.024496 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:34.024940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:34.025649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:34.026141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:34.026569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:34.041728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] HTTP exception thrown: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Request method failure captured: Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 HTTP/1.1 Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_QAunsfxbY5LZNlg0CcEaoAih1Dbp5rakukzeijcKsJZVJj9-nZv3JlQKMwE6odXg4uuOl0oyLxNGODUUqyLj0jyR9f87zJrNSbTI1Fbeeg5aQ-MaCZXRVYuRbL9_askU1rDklSuZrpzwjEKIwLUeamM67Bkq_SpyisFX47UCcDBc Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:37:34.043433 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c219db8370d4ef49f235020868144d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c219db8370d4ef49f235020868144d7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: cdcfab461e534465a906c0eef201e423 Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:37:34.045031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '9ca6fe02-8975-4daa-a713-5ec2520b2d67'} Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:37:34.045818 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:37:34.047198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:37:34.049159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Returning 404 to user: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:37:34.050015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-28d4e390-3b31-46cf-9cf5-2f9330a4e540 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 404 len: 111 microversion: 2.1 time: 0.037594 Sep 26 10:37:34.051026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 302/628] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:34 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:37:34.059079 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bfed6a30-60ab-4ef9-ab2b-0df0d8b61e8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '.version_select at 0x7fbadb189b80>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:34.079398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-bfed6a30-60ab-4ef9-ab2b-0df0d8b61e8a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519479374" status: 202 len: 0 microversion: 2.1 time: 0.023946 Sep 26 10:37:34.079845 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 327/629] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 10:37:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519479374 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:37:34.346620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-67d868e5-b120-42d4-9978-2c5616a42f29 req-389cc415-be53-4d9d-979d-b36ad4086843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:34.378484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-67d868e5-b120-42d4-9978-2c5616a42f29 req-389cc415-be53-4d9d-979d-b36ad4086843 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:34.378973 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-67d868e5-b120-42d4-9978-2c5616a42f29 req-389cc415-be53-4d9d-979d-b36ad4086843 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:34.379395 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-67d868e5-b120-42d4-9978-2c5616a42f29 req-389cc415-be53-4d9d-979d-b36ad4086843 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:34.393846 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-67d868e5-b120-42d4-9978-2c5616a42f29 req-389cc415-be53-4d9d-979d-b36ad4086843 service nova] Creating event network-changed:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:37:34.402005 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-67d868e5-b120-42d4-9978-2c5616a42f29 req-389cc415-be53-4d9d-979d-b36ad4086843 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056637 Sep 26 10:37:34.402669 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 303/630] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:34.844398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-eea915d1-ecb0-4439-bd45-5cff8e5124ab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: .version_select at 0x7fbadb1e83a0>, body: {"keypair": {"name": "tempest-keypair-1810234085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKxSc/cWGe/Lr+KzeBDoyPVC1PrXTCmLdiurN+/OmE5Y+eNgwr82dnbwiUeSYBXVC3XUdnrlNTvPmXFm81wlO5BdmHj3HxySiRvRDtt9ksCgqu2EoE9899Q5sKAqfMM/g=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:34.860820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-eea915d1-ecb0-4439-bd45-5cff8e5124ab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for project 3c219db8370d4ef49f235020868144d7. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:37:34.865368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-eea915d1-ecb0-4439-bd45-5cff8e5124ab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for user cdcfab461e534465a906c0eef201e423 and project 3c219db8370d4ef49f235020868144d7. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:37:34.888425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-eea915d1-ecb0-4439-bd45-5cff8e5124ab tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048381 Sep 26 10:37:34.889034 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 328/631] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:37:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:34.959600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:34.960392 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:34.966761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:34.967318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:34.967830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:34.968687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:34.969136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:34.969554 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:35.128634 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:35.136638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:35.138102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:35.139193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0139befc-42cc-4d14-b193-b700a3f792dd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.184657 Sep 26 10:37:35.139845 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 304/632] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:34 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:36.166737 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:36.167413 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:36.174155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:36.174620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:36.175052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:36.175814 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:36.176269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:36.176740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:36.315333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:36.324136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:36.325601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:36.327534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d02cf8ca-5589-4385-b90f-0bbff604af96 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.164520 Sep 26 10:37:36.328109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 329/633] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:36 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:36.625483 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1026126", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9f0c1cf-9082-4631-962e-123de80a2bb4"}], "security_groups": [{"name": "tempest-securitygroup--5332579"}], "key_name": "tempest-keypair-1810234085", "user_data": "}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:36.727963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] validate_networks() for [('f9f0c1cf-9082-4631-962e-123de80a2bb4', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:37:37.101781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:37:37.102251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:37:37.102721 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:37:37.103127 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:37:37.103792 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:37:37.112727 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:37.113214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:37.113648 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:37.114446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:37.114900 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:37.115324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:37.133056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for project 3c219db8370d4ef49f235020868144d7. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:37:37.137193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Getting quotas for user cdcfab461e534465a906c0eef201e423 and project 3c219db8370d4ef49f235020868144d7. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:37:37.148527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:37:37.150852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:37:37.201750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6a2262d0-e2c2-4fe1-91b2-75f263a37e66 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.580634 Sep 26 10:37:37.202430 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 305/634] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:37:36 2022] POST /compute/v2.1/servers => generated 399 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 10:37:37.215350 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-08c316c7-bb35-42ae-b9ed-088551842973 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:37.216174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-08c316c7-bb35-42ae-b9ed-088551842973 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:37.272990 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-08c316c7-bb35-42ae-b9ed-088551842973 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:37.279745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-08c316c7-bb35-42ae-b9ed-088551842973 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1235 microversion: 2.1 time: 0.068459 Sep 26 10:37:37.280307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 330/635] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:37 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:37.353209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:37.354055 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:37.360401 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:37.360893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:37.361330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:37.362040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:37.362504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:37.362926 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:37.498905 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:37.507469 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:37.509070 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:37.510192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8a2348bf-7d24-46cd-a61a-cdd0eeefcff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.161618 Sep 26 10:37:37.510742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 306/636] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:37 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:38.302963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:38.303604 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:38.310603 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:38.311084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:38.311517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:38.312199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:38.312651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:38.313074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:38.373223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:38.381554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c4a7ed2a-5c7a-446b-bf4f-3216050ed59e tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1287 microversion: 2.1 time: 0.082481 Sep 26 10:37:38.382155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 331/637] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:38 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:38.538860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:38.541266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:38.548481 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:38.549246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:38.549831 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:38.550880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:38.551477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:38.553030 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:38.696905 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:38.705122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:38.706759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:38.707903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7f86df45-4b54-4087-9634-868c38e64549 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.174722 Sep 26 10:37:38.708715 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 307/638] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:38 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:39.404822 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:39.406176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:39.412761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:39.413235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:39.413665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:39.414387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:39.414837 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:39.415259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:39.547531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:39.556310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f81026dc-2ddc-4a41-b17a-ed5167ebeb81 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.155370 Sep 26 10:37:39.556812 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 332/639] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:39 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:39.733033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:39.733643 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:39.740671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:39.741157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:39.741594 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:39.742321 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:39.742776 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:39.743202 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:39.883064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:39.893522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:39.895006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:39.896113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-96fae405-af6f-4339-8fa5-2a565c7752e0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.167307 Sep 26 10:37:39.896674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 308/640] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:39 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:39.925687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-a0f67855-8c1c-4403-a275-0b2b9745039d req-261417d2-4fa5-4778-a816-b85c66ebc6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81811a93-acfd-43d2-a99f-a4a1f54c4b60", "tag": "f6d3b71f-a23a-4160-8219-9acd1b33b609"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:39.935267 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a0f67855-8c1c-4403-a275-0b2b9745039d req-261417d2-4fa5-4778-a816-b85c66ebc6e5 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:39.935746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a0f67855-8c1c-4403-a275-0b2b9745039d req-261417d2-4fa5-4778-a816-b85c66ebc6e5 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:39.936810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-a0f67855-8c1c-4403-a275-0b2b9745039d req-261417d2-4fa5-4778-a816-b85c66ebc6e5 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:39.948364 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-a0f67855-8c1c-4403-a275-0b2b9745039d req-261417d2-4fa5-4778-a816-b85c66ebc6e5 service nova] Creating event network-changed:f6d3b71f-a23a-4160-8219-9acd1b33b609 for instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 on hv-cinder-84456 Sep 26 10:37:39.953673 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-a0f67855-8c1c-4403-a275-0b2b9745039d req-261417d2-4fa5-4778-a816-b85c66ebc6e5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032414 Sep 26 10:37:39.954771 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 333/641] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:40.177527 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-c6e43a29-eacd-44f5-abcd-223a4fb30f79 req-31baf532-1e9f-48ad-a424-7036401ae8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "name": "network-vif-plugged", "status": "completed", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:40.187990 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c6e43a29-eacd-44f5-abcd-223a4fb30f79 req-31baf532-1e9f-48ad-a424-7036401ae8af service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:40.188572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c6e43a29-eacd-44f5-abcd-223a4fb30f79 req-31baf532-1e9f-48ad-a424-7036401ae8af service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:40.189277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c6e43a29-eacd-44f5-abcd-223a4fb30f79 req-31baf532-1e9f-48ad-a424-7036401ae8af service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:40.201390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-c6e43a29-eacd-44f5-abcd-223a4fb30f79 req-31baf532-1e9f-48ad-a424-7036401ae8af service nova] Creating event network-vif-plugged:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:37:40.206361 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-c6e43a29-eacd-44f5-abcd-223a4fb30f79 req-31baf532-1e9f-48ad-a424-7036401ae8af service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033144 Sep 26 10:37:40.207137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 309/642] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:40.580239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:40.580948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:40.588311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:40.588741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:40.589181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:40.589876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:40.590368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:40.590802 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:40.717075 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:40.724692 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-199d0ce8-1f2f-445e-bb5c-54c6890780f5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.148682 Sep 26 10:37:40.725261 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 334/643] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:40 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:40.923740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:40.924378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:40.931046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:40.931531 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:40.931970 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:40.932662 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:40.933117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:40.933543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:40.937490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:41.063162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:41.071765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:41.073225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:41.074356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bcb3ed19-6eca-47a4-99b4-4862f566bd65 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.155438 Sep 26 10:37:41.074920 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 310/644] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:40 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:41.747672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:41.748320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:41.751333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:41.755769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:41.756265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:41.756709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:41.757414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:41.757874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:41.758330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:41.762481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:41.914988 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:41.922524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d0b2fab5-97b5-41ef-95a1-6b4bdacf145d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.178833 Sep 26 10:37:41.923100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 335/645] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:41 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:42.099667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:42.100271 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:42.106858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:42.107334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:42.107762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:42.108443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:42.108886 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:42.109328 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:42.312367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:42.321135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:42.322595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:42.323711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-18a5fcca-c1ce-4fb8-8dd3-f41eb778774f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1407 microversion: 2.20 time: 0.228041 Sep 26 10:37:42.324269 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 311/646] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:42 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:42.922783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:42.923325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:42.930210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:42.930690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:42.931122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:42.931809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:42.932264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:42.932688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:42.944770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:42.945448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:42.951605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:42.952095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:42.952665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:42.953357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:42.953809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:42.954257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:42.956100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c4dc1603-4076-4727-be67-6aad4cf4dc4f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/ips" status: 200 len: 150 microversion: 2.1 time: 0.037132 Sep 26 10:37:42.959574 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 336/647] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:37:42 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:43.096865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:43.106978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-362687d8-b1c1-4343-bf32-a0536bae1add tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.166194 Sep 26 10:37:43.108264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 312/648] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:42 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:37:43.349588 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:43.350223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:43.356244 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:43.356721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:43.357153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:43.357830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:43.358329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:43.358750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:43.484994 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:43.493137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:43.494619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:43.495757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3acc4ad2-0617-43a8-8c89-3990436605da tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1599 microversion: 2.20 time: 0.150867 Sep 26 10:37:43.496321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 337/649] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:37:43 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:37:43.521508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:43.522148 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:43.527958 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:43.528457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:43.528863 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:43.529552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:43.529994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:43.530488 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:43.608286 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-768acaf6-216f-4c22-a1e0-62f606435339 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091308 Sep 26 10:37:43.608884 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 313/650] 10.222.0.49 () {60 vars in 1316 bytes} [Mon Sep 26 10:37:43 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:37:44.132098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:44.132729 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:44.139301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:44.139792 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:44.140233 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:44.140935 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:44.141395 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:44.141823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:44.330768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d25818cc-9e51-47a6-93d6-c116762c566c"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:44.333101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:44.339467 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:44.339943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:44.340383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:44.341076 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:44.341712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:44.342162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:44.377384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:44.385557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f34495a4-1da6-4e72-b18e-14e7a034e9d1 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.258108 Sep 26 10:37:44.386160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 338/651] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:44 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:44.604858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-dba4ea46-6fb6-4452-b6ce-95ae94a5c81c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278261 Sep 26 10:37:44.605795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 314/652] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:37:44 2022] POST /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:37:44.671363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-68cf9492-50af-45a4-a317-446fdf38dd0e req-d0342372-4912-41ac-ab69-92116d583cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:44.686753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:44.690800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-68cf9492-50af-45a4-a317-446fdf38dd0e req-d0342372-4912-41ac-ab69-92116d583cb7 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:44.692758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-68cf9492-50af-45a4-a317-446fdf38dd0e req-d0342372-4912-41ac-ab69-92116d583cb7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:44.694471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-68cf9492-50af-45a4-a317-446fdf38dd0e req-d0342372-4912-41ac-ab69-92116d583cb7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:44.718929 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-68cf9492-50af-45a4-a317-446fdf38dd0e req-d0342372-4912-41ac-ab69-92116d583cb7 service nova] Creating event network-changed:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:37:44.728400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-68cf9492-50af-45a4-a317-446fdf38dd0e req-d0342372-4912-41ac-ab69-92116d583cb7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060160 Sep 26 10:37:44.730333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 339/653] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:45.409449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:45.410282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:45.416761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:45.417242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:45.417918 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:45.418706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:45.419222 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:45.419865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:45.596455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:45.605208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-77a2c85a-970c-47e0-97a2-3bd71bbe24ee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.200461 Sep 26 10:37:45.605773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 315/654] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:45 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:46.327292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-f7a6fec0-1e93-4099-addb-02e0fb5e2a22 req-6cb28f95-4a69-420b-9297-8473d0bcbe52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81811a93-acfd-43d2-a99f-a4a1f54c4b60", "name": "network-vif-plugged", "status": "completed", "tag": "f6d3b71f-a23a-4160-8219-9acd1b33b609"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:46.341153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-f7a6fec0-1e93-4099-addb-02e0fb5e2a22 req-6cb28f95-4a69-420b-9297-8473d0bcbe52 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:46.341632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-f7a6fec0-1e93-4099-addb-02e0fb5e2a22 req-6cb28f95-4a69-420b-9297-8473d0bcbe52 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:46.342075 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-f7a6fec0-1e93-4099-addb-02e0fb5e2a22 req-6cb28f95-4a69-420b-9297-8473d0bcbe52 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:46.353925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-f7a6fec0-1e93-4099-addb-02e0fb5e2a22 req-6cb28f95-4a69-420b-9297-8473d0bcbe52 service nova] Creating event network-vif-plugged:f6d3b71f-a23a-4160-8219-9acd1b33b609 for instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 on hv-cinder-84456 Sep 26 10:37:46.359414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-f7a6fec0-1e93-4099-addb-02e0fb5e2a22 req-6cb28f95-4a69-420b-9297-8473d0bcbe52 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036934 Sep 26 10:37:46.360015 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 340/655] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:46.627202 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:46.627816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:46.634771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:46.635244 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:46.635674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:46.636349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:46.636796 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:46.637213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:46.766162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:46.774210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-07cb5751-d55f-4393-b2c4-faf2d26ec7e5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.151027 Sep 26 10:37:46.774773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 316/656] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:46 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:47.256720 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:47.257305 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:47.264257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:47.264742 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:47.265177 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:47.265873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:47.266355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:47.266807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:47.280986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=16 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:47.346835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'services' on Instance uuid 31c4900f-d778-4d9f-98f5-2657ff241a0e {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:37:47.415961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1c754896-e306-4a9d-9f4e-4e45d40bb776 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments/5b034a4d-9ff5-4b95-b517-ea63127e283b" status: 202 len: 0 microversion: 2.1 time: 0.163540 Sep 26 10:37:47.416535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 341/657] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:37:47 2022] DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments/5b034a4d-9ff5-4b95-b517-ea63127e283b => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:37:47.424961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:47.427878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:47.429799 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:47.430923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=8 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:47.436682 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:47.437168 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:47.437605 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:47.438330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:47.438787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:47.439215 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:47.467737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fad78b62-8895-407b-971a-d7eff85f5fd0 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Sep 26 10:37:47.468230 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 317/658] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:47 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:47.797208 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:47.798871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:47.805620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:47.806128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:47.807005 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:47.807252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:47.807706 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:47.808128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:47.937290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:47.944825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7b72e25c-4118-46ce-944f-6414d94ac307 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1358 microversion: 2.1 time: 0.151861 Sep 26 10:37:47.945389 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 342/659] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:47 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:48.481245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:48.483480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:48.489820 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:48.490343 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:48.490786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:48.491475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:48.491933 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:48.492360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:48.522059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-80b5918d-a21c-4131-8ee7-6369ea03d493 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 26 10:37:48.522621 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 318/660] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:48 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:49.020093 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:49.021337 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:49.027185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:49.027672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:49.028114 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:49.028807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:49.029268 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:49.029700 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:49.160357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:49.167979 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-88f123f7-aa8f-4671-b7a7-2009e47799e4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1544 microversion: 2.1 time: 0.203867 Sep 26 10:37:49.168547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 343/661] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:48 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1544 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:49.190349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:49.190844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:49.197432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:49.197915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:49.198391 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:49.199075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:49.199529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:49.199953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:49.275801 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-230b1389-d0cc-47c2-938c-84d77fc39cf9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089296 Sep 26 10:37:49.276397 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 319/662] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:37:49 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:49.585446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:49.587705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:49.595545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:49.596321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:49.596772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:49.597707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:49.598220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:49.598655 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:49.632346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-31c5490e-7da5-49c3-a5d2-6d3c99f44ef7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101791 Sep 26 10:37:49.632925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 344/663] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:49 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:50.211750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-c716efd9-ef38-431a-98a7-89e85e363259 req-30ad3a69-e91b-46e6-a3e1-e1b89252cccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81811a93-acfd-43d2-a99f-a4a1f54c4b60", "tag": "f6d3b71f-a23a-4160-8219-9acd1b33b609"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:50.220957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c716efd9-ef38-431a-98a7-89e85e363259 req-30ad3a69-e91b-46e6-a3e1-e1b89252cccc service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:50.221427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c716efd9-ef38-431a-98a7-89e85e363259 req-30ad3a69-e91b-46e6-a3e1-e1b89252cccc service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:50.221848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c716efd9-ef38-431a-98a7-89e85e363259 req-30ad3a69-e91b-46e6-a3e1-e1b89252cccc service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:50.235082 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-c716efd9-ef38-431a-98a7-89e85e363259 req-30ad3a69-e91b-46e6-a3e1-e1b89252cccc service nova] Creating event network-changed:f6d3b71f-a23a-4160-8219-9acd1b33b609 for instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 on hv-cinder-84456 Sep 26 10:37:50.240665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-c716efd9-ef38-431a-98a7-89e85e363259 req-30ad3a69-e91b-46e6-a3e1-e1b89252cccc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033171 Sep 26 10:37:50.241263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 320/664] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:50.644874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:50.647054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:50.653471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:50.653958 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:50.654437 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:50.655137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:50.655593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:50.656020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:50.692454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6d9ed5c2-4907-4e42-9561-4484a07695ea tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049114 Sep 26 10:37:50.693618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 345/665] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:50 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:51.706650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:51.708897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:51.715223 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:51.715712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:51.716152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:51.716848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:51.717307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:51.717731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:51.748898 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cb7e9037-b784-4a44-9c12-16699084c256 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Sep 26 10:37:51.749690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 321/666] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:51 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:52.196084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d25818cc-9e51-47a6-93d6-c116762c566c"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:52.198415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:52.204783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.205262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.205698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.206411 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.206865 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.207288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.284629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Invalid volume: volume d25818cc-9e51-47a6-93d6-c116762c566c is already attached to instances: 32027e55-4845-402a-8c64-a0f4e072d638 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: POST /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments HTTP/1.1 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 74 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:37:52.288219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {"volumeAttachment": {"volumeId": "d25818cc-9e51-47a6-93d6-c116762c566c"}} Sep 26 10:37:52.289703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Invalid volume: volume d25818cc-9e51-47a6-93d6-c116762c566c is already attached to instances: 32027e55-4845-402a-8c64-a0f4e072d638 Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'server_id': '32027e55-4845-402a-8c64-a0f4e072d638', 'body': {'volumeAttachment': {'volumeId': 'd25818cc-9e51-47a6-93d6-c116762c566c'}}} Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d25818cc-9e51-47a6-93d6-c116762c566c is already attached to instances: 32027e55-4845-402a-8c64-a0f4e072d638 Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:52.290654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d25818cc-9e51-47a6-93d6-c116762c566c is already attached to instances: 32027e55-4845-402a-8c64-a0f4e072d638 Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:52.292076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d25818cc-9e51-47a6-93d6-c116762c566c is already attached to instances: 32027e55-4845-402a-8c64-a0f4e072d638 Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 400 to user: Invalid volume: volume d25818cc-9e51-47a6-93d6-c116762c566c is already attached to instances: 32027e55-4845-402a-8c64-a0f4e072d638 {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-35c9d44c-459a-4c43-aaaf-7b2fd50e197f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095707 Sep 26 10:37:52.293679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 346/667] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:37:52 2022] POST /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 26 10:37:52.353412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:52.354224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:52.360067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.360542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.360973 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.361655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.362144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.362569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.482153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lazy-loading 'services' on Instance uuid 32027e55-4845-402a-8c64-a0f4e072d638 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:37:52.590981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-06323a65-43e9-4272-b0f0-f810e3eedc9c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments/d25818cc-9e51-47a6-93d6-c116762c566c" status: 202 len: 0 microversion: 2.1 time: 0.241237 Sep 26 10:37:52.591981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 322/668] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:37:52 2022] DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments/d25818cc-9e51-47a6-93d6-c116762c566c => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:37:52.603546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:52.605926 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:52.613254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.613842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.615087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.615782 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.616232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.616650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.653896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2a89dad0-b789-42f2-b6fa-263e034b7d61 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055967 Sep 26 10:37:52.654487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 347/669] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:52 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:52.761290 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:52.763533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:52.765904 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:52.771509 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.771989 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.772426 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.773112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.773565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.773990 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.805358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-98606fa4-bbbc-4b22-9c4e-23586f1bb159 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048280 Sep 26 10:37:52.805920 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 323/670] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:52 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:37:52.881739 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:52.882261 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:52.888978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.889456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.889892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.890624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:52.891081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:52.891501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:52.916017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:37:52.986667 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6ee86634-2ff9-4e95-ad73-df3f21dce2c8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 204 len: 0 microversion: 2.1 time: 0.109326 Sep 26 10:37:52.987239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 348/671] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:37:52 2022] DELETE /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:37:52.995643 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:52.996308 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:53.002192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:53.002675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:53.003103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:53.003890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:53.004340 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:53.004759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:53.138598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:53.146273 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-53cbb014-85f3-467d-9898-afd1cbfd32b7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1689 microversion: 2.1 time: 0.154354 Sep 26 10:37:53.146841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 324/672] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:52 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:53.719962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:53.722237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:53.729820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:53.730355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:53.730793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:53.731499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:53.731954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:53.732402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:53.761205 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fd6be342-a705-4221-92ab-b6632f75dfed tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098093 Sep 26 10:37:53.761766 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 349/673] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:53 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:54.169466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:54.170132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:54.176653 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:54.177135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:54.177568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:54.178277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:54.178731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:54.179152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:54.308149 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:54.315751 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f3a0f649-6503-40e1-bb66-85f5b19ca0f9 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1689 microversion: 2.1 time: 0.150172 Sep 26 10:37:54.316320 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 325/674] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:54 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:54.773759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:54.775991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:54.782577 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:54.783093 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:54.783528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:54.784224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:54.784677 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:54.785117 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:54.817934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e49780e1-3938-490b-8130-9f9e69d6d13c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048120 Sep 26 10:37:54.818523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 350/675] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:54 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:55.339185 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:55.339872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:55.346233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:55.346706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:55.347129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:55.347807 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:55.348252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:55.349296 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:55.353084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:55.483965 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:55.491688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-10788db2-56d9-4652-9182-5c809ddeecc3 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1689 microversion: 2.1 time: 0.156392 Sep 26 10:37:55.492258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 326/676] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:55 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:55.830509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:55.832713 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:55.839717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:55.840197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:55.840632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:55.841317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:55.841764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:55.842210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:55.845964 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:37:55.874152 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-06f07b12-d678-4de4-a7e9-6d279b2ffb1b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Sep 26 10:37:55.874707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 351/677] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:55 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:56.515286 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:56.516805 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:56.523701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:56.524189 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:56.524629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:56.525325 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:56.525777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:56.526257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:56.665424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:56.673285 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fce40898-095c-4761-b25d-18561cb4bf0f tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1689 microversion: 2.1 time: 0.161786 Sep 26 10:37:56.673851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 327/678] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:56 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:56.886889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:56.889180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:56.895998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:56.896761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:56.897346 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:56.898079 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:56.898533 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:56.898957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:56.929243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-71a90092-b407-452c-87aa-fcf134d0130f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046565 Sep 26 10:37:56.929811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 352/679] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:37:56 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:37:56.993164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:56.993660 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:56.999749 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.000228 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.000654 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.001336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.001782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.002451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.028388 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:37:57.102741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f38d5a16-7b38-4d4c-b88a-ee9f8800d5c5 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 204 len: 0 microversion: 2.1 time: 0.113113 Sep 26 10:37:57.106627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 328/680] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:37:56 2022] DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:37:57.111940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:57.112559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:57.118294 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.118787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.119229 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.119925 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.120379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.120802 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.323387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:57.331065 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1adc97b6-48b1-4521-92f6-d678c8817d22 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1681 microversion: 2.1 time: 0.223171 Sep 26 10:37:57.331635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 353/681] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:57 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1681 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:57.579494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-1482db62-b881-46e9-b717-4b3fdab11f77 req-b468f557-7683-4e67-ab86-f83396ce00d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c4900f-d778-4d9f-98f5-2657ff241a0e", "name": "network-vif-deleted", "tag": "852a1cf1-997f-48f3-ba24-fee4c258bd27"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:37:57.589310 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-1482db62-b881-46e9-b717-4b3fdab11f77 req-b468f557-7683-4e67-ab86-f83396ce00d6 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.589778 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-1482db62-b881-46e9-b717-4b3fdab11f77 req-b468f557-7683-4e67-ab86-f83396ce00d6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.590229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-1482db62-b881-46e9-b717-4b3fdab11f77 req-b468f557-7683-4e67-ab86-f83396ce00d6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.603085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-1482db62-b881-46e9-b717-4b3fdab11f77 req-b468f557-7683-4e67-ab86-f83396ce00d6 service nova] Creating event network-vif-deleted:852a1cf1-997f-48f3-ba24-fee4c258bd27 for instance 31c4900f-d778-4d9f-98f5-2657ff241a0e on hv-cinder-84456 Sep 26 10:37:57.608359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-1482db62-b881-46e9-b717-4b3fdab11f77 req-b468f557-7683-4e67-ab86-f83396ce00d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032955 Sep 26 10:37:57.608950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 329/682] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:37:57.697570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:57.698314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:57.704443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.704942 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.705382 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.706118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:57.706785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:57.707382 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:57.774367 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:57.782144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5c0874a5-78fc-4914-b39f-fee9e6b467df tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1622 microversion: 2.1 time: 0.088497 Sep 26 10:37:57.782723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 354/683] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:57 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1622 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:58.356396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:58.357083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:58.363563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:58.364063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:58.365002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:58.365688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:58.366155 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:58.366570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:58.500930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:58.508708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-459842a5-df97-41ee-bf82-888789d4f366 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1681 microversion: 2.1 time: 0.156703 Sep 26 10:37:58.509284 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 330/684] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:58 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:58.806610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:58.807000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:58.813430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:58.813920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:58.814396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:58.815090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:58.815554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:58.815984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:58.846373 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:58.846860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:58.847301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:58.847747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'fault' on Instance uuid 31c4900f-d778-4d9f-98f5-2657ff241a0e {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:37:58.887948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:58.896147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-eeac4860-3a99-4de2-b08b-fc54dbea90c2 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 200 len: 1336 microversion: 2.1 time: 0.093703 Sep 26 10:37:58.907916 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 355/685] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:58 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:59.531779 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:59.532528 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:59.539789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:59.540410 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:59.540852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:59.541751 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:59.542252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:59.542687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:59.772885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:37:59.780466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-6e1284f1-1fda-4717-84f7-85ffc471fa2f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1681 microversion: 2.1 time: 0.252629 Sep 26 10:37:59.781031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 331/686] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:59 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1681 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:37:59.919347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:59.921200 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 31c4900f-d778-4d9f-98f5-2657ff241a0e] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:37:59.928313 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:59.928831 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:59.929274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:59.930102 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:37:59.930574 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:37:59.931004 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:37:59.945127 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] HTTP exception thrown: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e could not be found. Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Request method failure captured: Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e HTTP/1.1 Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QRZkIEazrHPp-ASawOGwhHKFneNncuKdrdU4jdL9mPTE68D6RIU6Tfs4pCHVzucWAe0FQlnAR5WeU26ZPDFO5PP3iYiPVIqUBsIRXPpJ6UrsXcVIuEkaZWOrJHn_jdqIiga6LqGme456-g87uXjHzgMbC3qHWSOXVyGjEtwT1DcU Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:37:59.946828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_615e5825389c4f1d96e6398bf1dab735", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 5085a918c6b74488b3dd70c1fb257381 Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e could not be found. Sep 26 10:37:59.948459 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '31c4900f-d778-4d9f-98f5-2657ff241a0e'} Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e could not be found. Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:37:59.949559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e could not be found. Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e could not be found. Sep 26 10:37:59.950936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:37:59.952608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Returning 404 to user: Instance 31c4900f-d778-4d9f-98f5-2657ff241a0e could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:37:59.952608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3838f1ea-ddf8-45b4-9864-e3dd24bde88e tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e" status: 404 len: 111 microversion: 2.1 time: 0.032756 Sep 26 10:37:59.952608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 356/687] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:37:59 2022] GET /compute/v2.1/servers/31c4900f-d778-4d9f-98f5-2657ff241a0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:37:59.957258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b3dba16f-b1fc-49d0-9db9-0cf32367895c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '.version_select at 0x7fbadb15a1f0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:37:59.976486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b3dba16f-b1fc-49d0-9db9-0cf32367895c tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442016636" status: 202 len: 0 microversion: 2.1 time: 0.023028 Sep 26 10:37:59.977059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 332/688] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 10:37:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1442016636 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:00.180965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-19826128-814f-4f6f-a609-f886654e4660 req-a6645653-f6c5-4db4-9d40-f245f9b3a8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32027e55-4845-402a-8c64-a0f4e072d638", "name": "network-vif-deleted", "tag": "e017867e-26ce-4cd5-b184-7ac0182d7fb4"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:00.192160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-19826128-814f-4f6f-a609-f886654e4660 req-a6645653-f6c5-4db4-9d40-f245f9b3a8f4 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:00.193432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-19826128-814f-4f6f-a609-f886654e4660 req-a6645653-f6c5-4db4-9d40-f245f9b3a8f4 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:00.194043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-19826128-814f-4f6f-a609-f886654e4660 req-a6645653-f6c5-4db4-9d40-f245f9b3a8f4 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:00.207216 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-19826128-814f-4f6f-a609-f886654e4660 req-a6645653-f6c5-4db4-9d40-f245f9b3a8f4 service nova] Creating event network-vif-deleted:e017867e-26ce-4cd5-b184-7ac0182d7fb4 for instance 32027e55-4845-402a-8c64-a0f4e072d638 on hv-cinder-84456 Sep 26 10:38:00.219805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-19826128-814f-4f6f-a609-f886654e4660 req-a6645653-f6c5-4db4-9d40-f245f9b3a8f4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043839 Sep 26 10:38:00.220644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 357/689] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:00.825906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:00.826992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:00.835169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:00.835860 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:00.836447 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:00.837233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:00.837722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:00.838318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:00.873871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:00.875413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:00.877559 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:00.878507 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lazy-loading 'fault' on Instance uuid 32027e55-4845-402a-8c64-a0f4e072d638 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:00.924943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:00.934120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e3661f47-dbdc-4654-a905-372b33f71e42 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 200 len: 1330 microversion: 2.1 time: 0.133755 Sep 26 10:38:00.935033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 333/690] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:00 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 1330 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:01.029377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1172863596"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:01.030691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:01.036800 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:01.037287 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:01.037735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:01.038454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:01.038910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:01.039333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:01.173220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.network.security_group_api [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Removing security group 9a1b72b1-178f-494b-b00c-78edf514c9a7 from port c3b3988b-57fd-4956-8209-afc0f13b21e0 Sep 26 10:38:01.494426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e05b69dd-b6cd-4bd3-a34e-f86a533be938 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/action" status: 202 len: 0 microversion: 2.1 time: 0.468958 Sep 26 10:38:01.494426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 358/691] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:38:01 2022] POST /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:01.958679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:01.959292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:01.965673 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:01.966192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:01.966628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:01.967311 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:01.967765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:01.968187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:01.982223 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 HTTP/1.1 Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:38:01.983932 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:38:01.985424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '32027e55-4845-402a-8c64-a0f4e072d638'} Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:01.986341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:38:01.987512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:01.988586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:01.988586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1978545a-592c-4c1c-ad76-b419f5519440 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 404 len: 111 microversion: 2.1 time: 0.031130 Sep 26 10:38:01.988586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 334/692] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:01 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:01.994231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-938af4a0-ed61-4e28-a656-d94a23c25397 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '.version_select at 0x7fbadb163ca0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:02.013833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-938af4a0-ed61-4e28-a656-d94a23c25397 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-415430982" status: 202 len: 0 microversion: 2.1 time: 0.023139 Sep 26 10:38:02.014452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 359/693] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 10:38:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-415430982 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:02.292840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-be9c8222-ba07-482c-ba35-ba1498131d50 req-7357b023-4663-46a3-8016-6e18da676e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:02.304256 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-be9c8222-ba07-482c-ba35-ba1498131d50 req-7357b023-4663-46a3-8016-6e18da676e85 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.305219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-be9c8222-ba07-482c-ba35-ba1498131d50 req-7357b023-4663-46a3-8016-6e18da676e85 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.305650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-be9c8222-ba07-482c-ba35-ba1498131d50 req-7357b023-4663-46a3-8016-6e18da676e85 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:02.321628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-be9c8222-ba07-482c-ba35-ba1498131d50 req-7357b023-4663-46a3-8016-6e18da676e85 service nova] Creating event network-changed:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:38:02.326850 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-be9c8222-ba07-482c-ba35-ba1498131d50 req-7357b023-4663-46a3-8016-6e18da676e85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039422 Sep 26 10:38:02.327670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 335/694] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:38:02.673356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-00b50713-a368-46a7-a94c-4e3b5580862e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: .version_select at 0x7fbadb1ae940>, body: {"keypair": {"name": "tempest-keypair-387673985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNc1hVjBTBaIaFSz0B7QFxzWliD0ECoXq43+NMfyPefn798vXxMbPFaRBERIBOvMQLpL9e0Z8AwlIs05rWoQLbeFNBpZK5s7FVGucZQPtc4aOx3YlLm5ixzQnLfSsT+MVQ=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:02.689799 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-00b50713-a368-46a7-a94c-4e3b5580862e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:38:02.693743 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-00b50713-a368-46a7-a94c-4e3b5580862e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:38:02.716228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-00b50713-a368-46a7-a94c-4e3b5580862e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046745 Sep 26 10:38:02.717136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 360/695] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:38:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:02.728002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:02.728950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:02.735813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.736459 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.737066 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:02.737995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.738543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.739077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:02.827739 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lazy-loading 'services' on Instance uuid 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:02.902914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-17ae35c8-599f-4bba-a37b-e316eda59185 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments/fd483d93-0073-4c6b-b616-57d2562ec908" status: 202 len: 0 microversion: 2.1 time: 0.180312 Sep 26 10:38:02.903906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 336/696] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:38:02 2022] DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments/fd483d93-0073-4c6b-b616-57d2562ec908 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:02.913829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:02.916638 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:02.923968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.924813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.925518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:02.926638 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.927356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.928004 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:02.973535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-740c949b-2b5d-4485-a836-c832e99f3edd tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064682 Sep 26 10:38:02.975357 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 361/697] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:02 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:02.986382 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:02.987562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:02.994719 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.995480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.995928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:02.996770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:02.997387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:02.997988 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:03.026608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:38:03.122040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3f01abd2-820d-44ed-9a55-cbd29c06fb85 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 204 len: 0 microversion: 2.1 time: 0.140332 Sep 26 10:38:03.123513 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 337/698] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:38:02 2022] DELETE /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:38:03.131997 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:03.132621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:03.138917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:03.139408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:03.139852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:03.140575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:03.141332 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:03.141771 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:03.322783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:03.332340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-495eda21-5382-4e3b-a1db-5d4bef454043 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1507 microversion: 2.1 time: 0.204702 Sep 26 10:38:03.350422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 362/699] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:03 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1507 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:03.987693 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:03.990728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:03.997081 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:03.997562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:03.997997 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:03.998720 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:03.999172 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:03.999596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:04.028907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-31c9fef8-a428-4cc2-a3af-7a256b418903 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045616 Sep 26 10:38:04.029517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 338/700] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:03 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:04.310680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-261891966", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bfae35e-29c7-4379-ac17-c54030a00cba"}], "security_groups": [{"name": "tempest-securitygroup--331012807"}], "key_name": "tempest-keypair-387673985", "user_data": "}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:04.356771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:04.357404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:04.363360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:04.363842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:04.364272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:04.364956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:04.365403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:04.365821 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:04.440283 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] validate_networks() for [('5bfae35e-29c7-4379-ac17-c54030a00cba', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:38:04.581000 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:04.590313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3f41a329-bae4-41cb-8092-d41e4c79b912 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1507 microversion: 2.1 time: 0.237804 Sep 26 10:38:04.591336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 339/701] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:04 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:04.596092 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-58b21506-402b-4827-8bdd-2d00f22e44a2 req-ec9a20b7-9418-4e3e-bea0-674d7f5f2f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:04.605632 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-58b21506-402b-4827-8bdd-2d00f22e44a2 req-ec9a20b7-9418-4e3e-bea0-674d7f5f2f2f service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:04.606260 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-58b21506-402b-4827-8bdd-2d00f22e44a2 req-ec9a20b7-9418-4e3e-bea0-674d7f5f2f2f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:04.606568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-58b21506-402b-4827-8bdd-2d00f22e44a2 req-ec9a20b7-9418-4e3e-bea0-674d7f5f2f2f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:04.619274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-58b21506-402b-4827-8bdd-2d00f22e44a2 req-ec9a20b7-9418-4e3e-bea0-674d7f5f2f2f service nova] Creating event network-changed:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:38:04.624171 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-58b21506-402b-4827-8bdd-2d00f22e44a2 req-ec9a20b7-9418-4e3e-bea0-674d7f5f2f2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031488 Sep 26 10:38:04.624776 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 340/702] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:05.041679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:05.044110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:05.051119 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:05.052108 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:05.052569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:05.053270 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:05.053720 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:05.054178 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:05.084443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-772484e6-6048-4003-b54e-a18ebdc4725e tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047174 Sep 26 10:38:05.085009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 341/703] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:05 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:38:05.131255 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:38:05.131678 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:38:05.132142 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:38:05.132539 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:38:05.132946 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:38:05.141540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:05.142040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:05.142477 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:05.143320 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:05.143771 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:05.144188 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:05.160285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:38:05.164169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Getting quotas for user b486a094550541729c19c8713a648243 and project 49df2764440f4f2cb68d8d6284f07f47. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:38:05.174761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:38:05.177518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:38:05.225204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2c126a67-6b1f-4761-a784-6ef22cd7d3dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.918753 Sep 26 10:38:05.225945 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 363/704] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:38:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:38:05.237305 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-77d54932-4bd6-4d2e-854a-da7117956535 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:05.237939 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-77d54932-4bd6-4d2e-854a-da7117956535 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:05.292192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-77d54932-4bd6-4d2e-854a-da7117956535 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:05.298907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-77d54932-4bd6-4d2e-854a-da7117956535 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1240 microversion: 2.1 time: 0.065348 Sep 26 10:38:05.300088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 342/705] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:05 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:05.613929 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:05.618469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:05.624675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:05.625165 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:05.625768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:05.626322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:05.626779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:05.627204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:05.873404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:05.886864 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b57c8546-9d60-4c16-b35c-c800616815da tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1507 microversion: 2.1 time: 0.274693 Sep 26 10:38:05.890104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 364/706] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:05 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:06.097837 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:06.101323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:06.108928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.109530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.110052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.110768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.111225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.111650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.116952 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:06.150879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-185a85a9-76b1-4044-90e9-3ab95bc58323 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057690 Sep 26 10:38:06.155244 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 343/707] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:06 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:38:06.162820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:06.163376 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:06.169516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.170002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.170465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.171162 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.171681 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.172446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.276364 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] HTTP exception thrown: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 is not attached to volume fd483d93-0073-4c6b-b616-57d2562ec908 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Request method failure captured: Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments/fd483d93-0073-4c6b-b616-57d2562ec908 HTTP/1.1 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYBT0vhhxuht29kYYtwhG1S8u7lJVm96Q0E1aDn10k3yh3PMZBSrO1cYxfJWym5D-kXF_jOW0cOY630KlghjJDfcC4-gVsTH8ShwOMdEIzYQc73UMyq1w3kMxpJW7Yx6ak0x1nSqxdizcNs822O8eKEE-YZyyVCkXEI1-uxYgOyMsw4 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 6bb20c7af7544a06adaa9b5e47b03cd1 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-TestMinimumBasicScenario-960653108 Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:06.308252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bb20c7af7544a06adaa9b5e47b03cd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bb20c7af7544a06adaa9b5e47b03cd1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bb20c7af7544a06adaa9b5e47b03cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bb20c7af7544a06adaa9b5e47b03cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-TestMinimumBasicScenario-960653108 Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 6bb20c7af7544a06adaa9b5e47b03cd1 Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-TestMinimumBasicScenario-960653108 Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-TestMinimumBasicScenario-960653108-project Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 681edd9335a644a69a497a5c528920a8 Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-TestMinimumBasicScenario-960653108-project Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:06.309560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 is not attached to volume fd483d93-0073-4c6b-b616-57d2562ec908 Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'server_id': '01c39daa-dd73-454c-a4e9-5f0acc6c6d84', 'id': 'fd483d93-0073-4c6b-b616-57d2562ec908'} Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fd483d93-0073-4c6b-b616-57d2562ec908. Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:06.310311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 is not attached to volume fd483d93-0073-4c6b-b616-57d2562ec908 Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 is not attached to volume fd483d93-0073-4c6b-b616-57d2562ec908 Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:06.311387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Returning 404 to user: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 is not attached to volume fd483d93-0073-4c6b-b616-57d2562ec908 {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:06.312273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-09da0777-95cd-4622-82c4-915957b364bc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments/fd483d93-0073-4c6b-b616-57d2562ec908" status: 404 len: 154 microversion: 2.1 time: 0.151672 Sep 26 10:38:06.312273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 365/708] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:38:06 2022] DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84/os-volume_attachments/fd483d93-0073-4c6b-b616-57d2562ec908 => generated 154 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:38:06.322928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:06.327879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:06.346663 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.347504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.348051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.349231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.350970 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.352298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.452401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-fad8e03f-1755-4b2c-ac69-3e278e90e858 req-3ee0052d-cf4b-4c86-9b73-24aec38b3460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85ae4608-c737-41ca-83a0-2fab0aebd65f", "name": "network-vif-deleted", "tag": "696dd099-9ca9-4a5d-a056-1b76c99ea49e"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:06.463757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fad8e03f-1755-4b2c-ac69-3e278e90e858 req-3ee0052d-cf4b-4c86-9b73-24aec38b3460 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.464435 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fad8e03f-1755-4b2c-ac69-3e278e90e858 req-3ee0052d-cf4b-4c86-9b73-24aec38b3460 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.465103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fad8e03f-1755-4b2c-ac69-3e278e90e858 req-3ee0052d-cf4b-4c86-9b73-24aec38b3460 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.471106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:06.479432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-549406b4-61bd-430e-b91e-f2fb0a5e1926 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1292 microversion: 2.1 time: 0.160110 Sep 26 10:38:06.494048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 344/709] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:06 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1292 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:06.494259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-fad8e03f-1755-4b2c-ac69-3e278e90e858 req-3ee0052d-cf4b-4c86-9b73-24aec38b3460 service nova] Creating event network-vif-deleted:696dd099-9ca9-4a5d-a056-1b76c99ea49e for instance 85ae4608-c737-41ca-83a0-2fab0aebd65f on hv-cinder-84456 Sep 26 10:38:06.497062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-fad8e03f-1755-4b2c-ac69-3e278e90e858 req-3ee0052d-cf4b-4c86-9b73-24aec38b3460 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129920 Sep 26 10:38:06.497648 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 366/710] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:06.913457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:06.914095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:06.919853 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.920347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.920964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.922317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.922317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.922804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.955685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:06.956179 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:06.956615 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:06.957061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'fault' on Instance uuid 85ae4608-c737-41ca-83a0-2fab0aebd65f {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:07.000008 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:07.007827 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fffa96dc-5900-466d-87c7-b3458e3d3e26 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 200 len: 1312 microversion: 2.1 time: 0.099545 Sep 26 10:38:07.008399 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 345/711] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:06 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:07.505247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:07.505958 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:07.511763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:07.512202 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:07.512319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:07.512621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:07.513057 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:07.514064 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:07.514545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:07.514968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:07.518690 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:07.519354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:07.519797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:07.520530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:07.521138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:07.521569 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:07.547461 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:38:07.662166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-34a49d41-89a2-4dd4-90c1-43f51a295e2c tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 204 len: 0 microversion: 2.1 time: 0.153276 Sep 26 10:38:07.663195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 346/712] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:38:07 2022] DELETE /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 10:38:07.674998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:07.675922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:07.684774 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:07.685639 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:07.686447 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:07.687480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:07.688128 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:07.688833 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:07.720696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:07.729607 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b24f670b-2a49-44ff-ad29-843451265148 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.228873 Sep 26 10:38:07.732349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 367/713] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:07 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:07.847966 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:07.856243 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7c2d3ba5-4677-4d9b-b623-b8b65d74c258 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1554 microversion: 2.1 time: 0.187352 Sep 26 10:38:07.856828 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 347/714] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:07 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:08.030955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:08.031571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 85ae4608-c737-41ca-83a0-2fab0aebd65f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:08.037571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.038093 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.038535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.039229 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.039683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.040106 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.054095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] HTTP exception thrown: Instance 85ae4608-c737-41ca-83a0-2fab0aebd65f could not be found. Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Request method failure captured: Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f HTTP/1.1 Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QRZkIEazrHPp-ASawOGwhHKFneNncuKdrdU4jdL9mPTE68D6RIU6Tfs4pCHVzucWAe0FQlnAR5WeU26ZPDFO5PP3iYiPVIqUBsIRXPpJ6UrsXcVIuEkaZWOrJHn_jdqIiga6LqGme456-g87uXjHzgMbC3qHWSOXVyGjEtwT1DcU Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:08.055825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_615e5825389c4f1d96e6398bf1dab735", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 5085a918c6b74488b3dd70c1fb257381 Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 85ae4608-c737-41ca-83a0-2fab0aebd65f could not be found. Sep 26 10:38:08.057353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '85ae4608-c737-41ca-83a0-2fab0aebd65f'} Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85ae4608-c737-41ca-83a0-2fab0aebd65f could not be found. Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:08.058605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85ae4608-c737-41ca-83a0-2fab0aebd65f could not be found. Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85ae4608-c737-41ca-83a0-2fab0aebd65f could not be found. Sep 26 10:38:08.060040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:08.061277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Returning 404 to user: Instance 85ae4608-c737-41ca-83a0-2fab0aebd65f could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:08.061277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a9f2f484-e2d5-4fcc-816f-4e508060cad7 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f" status: 404 len: 111 microversion: 2.1 time: 0.030081 Sep 26 10:38:08.061277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 368/715] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:08 2022] GET /compute/v2.1/servers/85ae4608-c737-41ca-83a0-2fab0aebd65f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:38:08.066722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:08.068004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:08.074391 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.074872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.075303 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.076395 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.077007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.077562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.103165 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:38:08.184602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fd4d4bfd-509e-41c7-80f1-71381af36053 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 204 len: 0 microversion: 2.1 time: 0.121543 Sep 26 10:38:08.185285 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 348/716] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:38:08 2022] DELETE /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:38:08.193714 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:08.194342 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:08.200111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.200599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.201038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.201728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.202291 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.202722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.339454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:08.347336 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2fc2dee3-585c-453d-ac89-ad3d7bbeb331 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.157953 Sep 26 10:38:08.347911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 369/717] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:08 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:08.511529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-b5bed64d-8cd7-4ba7-afe9-475796d98d2c req-bce20b36-478c-41f6-aed4-de6f77e2d22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a0d990-0849-4bdf-b998-46ef72a35795", "tag": "8381e42d-d3f3-48fb-ac13-b807cee6c194"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:08.521097 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-b5bed64d-8cd7-4ba7-afe9-475796d98d2c req-bce20b36-478c-41f6-aed4-de6f77e2d22a service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.521654 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-b5bed64d-8cd7-4ba7-afe9-475796d98d2c req-bce20b36-478c-41f6-aed4-de6f77e2d22a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.521970 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-b5bed64d-8cd7-4ba7-afe9-475796d98d2c req-bce20b36-478c-41f6-aed4-de6f77e2d22a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.532524 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-b5bed64d-8cd7-4ba7-afe9-475796d98d2c req-bce20b36-478c-41f6-aed4-de6f77e2d22a service nova] Creating event network-changed:8381e42d-d3f3-48fb-ac13-b807cee6c194 for instance 86a0d990-0849-4bdf-b998-46ef72a35795 on hv-cinder-84456 Sep 26 10:38:08.537676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-b5bed64d-8cd7-4ba7-afe9-475796d98d2c req-bce20b36-478c-41f6-aed4-de6f77e2d22a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030141 Sep 26 10:38:08.538298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 349/718] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:08.758790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:08.759414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:08.766159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.766653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.767104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.767798 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.768258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.768686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.880520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:08.881214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:08.887174 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.887654 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.888082 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.888755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:08.889201 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:08.889614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:08.898147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:08.905734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-facff199-5a5d-43bd-81f0-9041491e9184 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.150905 Sep 26 10:38:08.906314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 370/719] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:08 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:09.022595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:09.030111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4059c9c2-8e87-4caa-bb5e-9a2a5d6b0889 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1554 microversion: 2.1 time: 0.153714 Sep 26 10:38:09.030677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 350/720] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:08 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:09.374503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:09.375134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:09.378876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:09.383999 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:09.384564 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:09.385013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:09.385717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:09.386206 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:09.386628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:09.517497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:09.525082 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b48cf9a5-7a01-4429-9753-427f96030c04 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.157094 Sep 26 10:38:09.525646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 371/721] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:09 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:09.929597 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:09.930290 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:09.936719 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:09.937204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:09.937646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:09.938373 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:09.938834 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:09.939262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:10.052801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:10.053416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:10.059747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:10.060231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:10.060668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:10.061396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:10.061850 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:10.062311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:10.072655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:10.080309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b365670b-0577-494e-8b79-57308cc42538 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.155238 Sep 26 10:38:10.080883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 351/722] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:09 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:10.190699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:10.198356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7ffa8405-e078-4411-886b-92c1f5a4f766 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1554 microversion: 2.1 time: 0.149911 Sep 26 10:38:10.198927 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 372/723] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:10 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:10.548110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:10.548719 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:10.554668 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:10.555152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:10.555586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:10.556272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:10.556725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:10.557150 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:10.688322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:10.696329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5aa85f95-bb13-49c2-ac93-ba9e529c081a tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.152078 Sep 26 10:38:10.696894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 352/724] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:10 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:11.102897 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:11.103465 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:11.110086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:11.110569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:11.111000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:11.111680 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:11.112136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:11.112552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:11.116825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:11.224074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:11.224852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:11.231493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:11.231977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:11.232408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:11.233104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:11.233566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:11.233983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:11.240717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:11.248254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-cd4fa990-6fb2-43e6-a471-16615061299f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.149256 Sep 26 10:38:11.248892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 373/725] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:11 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:11.366100 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:11.373668 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b8588ede-b444-410e-b63e-718cf5f4a56d tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1554 microversion: 2.1 time: 0.153998 Sep 26 10:38:11.374282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 353/726] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:11 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:11.719215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:11.719823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:11.725644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:11.726167 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:11.726602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:11.727282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:11.727733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:11.728151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:11.861069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:11.869086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-eeaec004-8144-4133-ae1f-9f94729a503d tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.153723 Sep 26 10:38:11.869653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 374/727] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:11 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:12.271118 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:12.271730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:12.278402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:12.278880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:12.279319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:12.280006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:12.280463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:12.280883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:12.397323 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:12.397981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:12.404458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:12.405011 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:12.405509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:12.406296 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:12.406751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:12.407171 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:12.408888 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:12.417048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ccaeeeb5-0090-446c-b1ee-1cd6bbf766ab tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.149760 Sep 26 10:38:12.417617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 354/728] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:12 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:12.538570 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:12.546118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e52bd496-2452-4566-96e5-ee09a21052dc tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1554 microversion: 2.1 time: 0.153311 Sep 26 10:38:12.546679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 375/729] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:12 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:12.892740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:12.893353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:12.900102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:12.900595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:12.901034 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:12.901733 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:12.902220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:12.902650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:13.191364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:13.201550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b3c55e2a-85b1-44b8-a2bc-50e8585df001 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1520 microversion: 2.1 time: 0.312728 Sep 26 10:38:13.210157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 355/730] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:12 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:13.440084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:13.440701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:13.448296 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:13.448984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:13.449519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:13.450349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:13.450900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:13.451675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:13.569074 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:13.570562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:13.578183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:13.578687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:13.579126 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:13.580146 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:13.580619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:13.581051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:13.769086 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:13.776783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-974c6c58-a3af-4500-97c3-6c361db2d86f tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.340614 Sep 26 10:38:13.777569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 376/731] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:13 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:13.930255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:13.933756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:13.939193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-58b27a7e-6a0d-43e6-9335-74ba8c80da44 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1554 microversion: 2.1 time: 0.374178 Sep 26 10:38:13.939767 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 356/732] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:13 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1554 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:14.067355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-29284c9f-de04-41c0-bf4d-f3a8a775cc34 req-e1961530-b70f-488a-8e06-4f4723828cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c39daa-dd73-454c-a4e9-5f0acc6c6d84", "name": "network-vif-deleted", "tag": "c3b3988b-57fd-4956-8209-afc0f13b21e0"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:14.076562 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-29284c9f-de04-41c0-bf4d-f3a8a775cc34 req-e1961530-b70f-488a-8e06-4f4723828cdf service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.077103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-29284c9f-de04-41c0-bf4d-f3a8a775cc34 req-e1961530-b70f-488a-8e06-4f4723828cdf service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.077520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-29284c9f-de04-41c0-bf4d-f3a8a775cc34 req-e1961530-b70f-488a-8e06-4f4723828cdf service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:14.088723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-29284c9f-de04-41c0-bf4d-f3a8a775cc34 req-e1961530-b70f-488a-8e06-4f4723828cdf service nova] Creating event network-vif-deleted:c3b3988b-57fd-4956-8209-afc0f13b21e0 for instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 on hv-cinder-84456 Sep 26 10:38:14.093574 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-29284c9f-de04-41c0-bf4d-f3a8a775cc34 req-e1961530-b70f-488a-8e06-4f4723828cdf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085135 Sep 26 10:38:14.094170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 377/733] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:14.225977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:14.226604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:14.228367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:14.234935 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.235354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.235777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:14.236463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.236911 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.237327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:14.304522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:14.312983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4fd9337c-519a-4ebb-b8af-6ac679cf16e8 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1478 microversion: 2.1 time: 0.092021 Sep 26 10:38:14.313826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 357/734] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:14 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1478 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:14.801572 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:14.802363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:14.808608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.809186 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.809690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:14.810475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.810994 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.811484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:14.945936 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:14.953457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fe4bcca3-7eee-49e0-93e5-880cecc571dd tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.156725 Sep 26 10:38:14.954016 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 378/735] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:14 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:14.964370 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:14.965019 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:14.971502 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.971986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.972421 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:14.973107 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:14.974191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:14.974618 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:15.006194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:15.006656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:15.007086 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:15.007525 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lazy-loading 'fault' on Instance uuid 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:15.049405 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '681edd9335a644a69a497a5c528920a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bb20c7af7544a06adaa9b5e47b03cd1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:15.057092 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-31fcfd4c-595e-452b-92d2-e93edcf3c925 tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 200 len: 1349 microversion: 2.1 time: 0.096679 Sep 26 10:38:15.057700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 358/736] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:14 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 1349 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:15.336906 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:15.337519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:15.339463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:15.340125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=10 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:15.346052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:15.346546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:15.346989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:15.347679 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:15.348134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:15.348559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:15.378870 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:15.379349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:15.380443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:15.380913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lazy-loading 'fault' on Instance uuid 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:15.420238 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5085a918c6b74488b3dd70c1fb257381', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '615e5825389c4f1d96e6398bf1dab735', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:15.428315 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-855e00af-0bf9-4f2c-9286-adfcefc2ae9b tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 200 len: 1311 microversion: 2.1 time: 0.095838 Sep 26 10:38:15.428899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 379/737] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:15 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:15.976911 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:15.977516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:15.979611 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:15.985595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:15.986103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:15.986538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:15.987224 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:15.987670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:15.988093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:16.080611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:16.081235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] [instance: 01c39daa-dd73-454c-a4e9-5f0acc6c6d84] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:16.088182 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:16.088671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:16.089114 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:16.089808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:16.090299 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:16.090733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:16.105057 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] HTTP exception thrown: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 could not be found. Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Request method failure captured: Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 HTTP/1.1 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYBT0vhhxuht29kYYtwhG1S8u7lJVm96Q0E1aDn10k3yh3PMZBSrO1cYxfJWym5D-kXF_jOW0cOY630KlghjJDfcC4-gVsTH8ShwOMdEIzYQc73UMyq1w3kMxpJW7Yx6ak0x1nSqxdizcNs822O8eKEE-YZyyVCkXEI1-uxYgOyMsw4 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 6bb20c7af7544a06adaa9b5e47b03cd1 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-TestMinimumBasicScenario-960653108 Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:16.106760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6bb20c7af7544a06adaa9b5e47b03cd1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6bb20c7af7544a06adaa9b5e47b03cd1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bb20c7af7544a06adaa9b5e47b03cd1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6bb20c7af7544a06adaa9b5e47b03cd1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-TestMinimumBasicScenario-960653108 Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 6bb20c7af7544a06adaa9b5e47b03cd1 Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-TestMinimumBasicScenario-960653108 Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-TestMinimumBasicScenario-960653108-project Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 681edd9335a644a69a497a5c528920a8 Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-TestMinimumBasicScenario-960653108-project Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 could not be found. Sep 26 10:38:16.108317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '01c39daa-dd73-454c-a4e9-5f0acc6c6d84'} Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 could not be found. Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:16.109499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 could not be found. Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 could not be found. Sep 26 10:38:16.111017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.113038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Returning 404 to user: Instance 01c39daa-dd73-454c-a4e9-5f0acc6c6d84 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:16.113038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5f48e283-55bf-42e8-a420-b90d07f434df tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84" status: 404 len: 111 microversion: 2.1 time: 0.031382 Sep 26 10:38:16.113038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 380/738] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:16 2022] GET /compute/v2.1/servers/01c39daa-dd73-454c-a4e9-5f0acc6c6d84 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:38:16.116179 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-bc1f44aa-70c9-4483-8251-256a73aad642 req-7aacc76b-325e-4931-8a1a-ccd150826864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8ccb32-956e-4b12-b59b-4763a8ac14e9", "name": "network-vif-deleted", "tag": "fb6f3a5e-f0d4-40e3-8d82-9ef01f3482ea"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:16.120216 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:16.125301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-bc1f44aa-70c9-4483-8251-256a73aad642 req-7aacc76b-325e-4931-8a1a-ccd150826864 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:16.125885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-bc1f44aa-70c9-4483-8251-256a73aad642 req-7aacc76b-325e-4931-8a1a-ccd150826864 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:16.126353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-bc1f44aa-70c9-4483-8251-256a73aad642 req-7aacc76b-325e-4931-8a1a-ccd150826864 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:16.127969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-72251434-344e-43c3-bb9a-c5554868d651 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.155448 Sep 26 10:38:16.128529 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 359/739] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:15 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:16.133052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5830d251-6dad-4294-99db-cf8c57b3527f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] Calling method '.version_select at 0x7fbadb15a3a0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:16.138396 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-bc1f44aa-70c9-4483-8251-256a73aad642 req-7aacc76b-325e-4931-8a1a-ccd150826864 service nova] Creating event network-vif-deleted:fb6f3a5e-f0d4-40e3-8d82-9ef01f3482ea for instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 on hv-cinder-84456 Sep 26 10:38:16.143072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-bc1f44aa-70c9-4483-8251-256a73aad642 req-7aacc76b-325e-4931-8a1a-ccd150826864 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 Sep 26 10:38:16.143651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 381/740] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:16.152264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5830d251-6dad-4294-99db-cf8c57b3527f tempest-TestMinimumBasicScenario-960653108 tempest-TestMinimumBasicScenario-960653108-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1337346705" status: 202 len: 0 microversion: 2.1 time: 0.022591 Sep 26 10:38:16.152828 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 360/741] 10.222.0.49 () {58 vars in 1272 bytes} [Mon Sep 26 10:38:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1337346705 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:16.452571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:16.453288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] [instance: 4c8ccb32-956e-4b12-b59b-4763a8ac14e9] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:16.460613 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:16.469667 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:16.470246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:16.471073 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:16.471746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:16.472266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:16.494656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] HTTP exception thrown: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 could not be found. Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Request method failure captured: Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 HTTP/1.1 Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QRZkIEazrHPp-ASawOGwhHKFneNncuKdrdU4jdL9mPTE68D6RIU6Tfs4pCHVzucWAe0FQlnAR5WeU26ZPDFO5PP3iYiPVIqUBsIRXPpJ6UrsXcVIuEkaZWOrJHn_jdqIiga6LqGme456-g87uXjHzgMbC3qHWSOXVyGjEtwT1DcU Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:16.496412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_615e5825389c4f1d96e6398bf1dab735", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/615e5825389c4f1d96e6398bf1dab735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 615e5825389c4f1d96e6398bf1dab735 Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1251645444 Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 5085a918c6b74488b3dd70c1fb257381 Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1251645444-project Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 could not be found. Sep 26 10:38:16.497950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '4c8ccb32-956e-4b12-b59b-4763a8ac14e9'} Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 could not be found. Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:16.498875 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 could not be found. Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 could not be found. Sep 26 10:38:16.500263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:16.501540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] Returning 404 to user: Instance 4c8ccb32-956e-4b12-b59b-4763a8ac14e9 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:16.501540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5c4799ad-108c-492a-8fab-ddf086c22192 tempest-ServerRescueNegativeTestJSON-1251645444 tempest-ServerRescueNegativeTestJSON-1251645444-project] 10.222.0.49 "GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9" status: 404 len: 111 microversion: 2.1 time: 0.049502 Sep 26 10:38:16.501540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 382/742] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:16 2022] GET /compute/v2.1/servers/4c8ccb32-956e-4b12-b59b-4763a8ac14e9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:17.155176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:17.156435 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:17.173817 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:17.174650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:17.175256 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:17.176104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:17.176707 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:17.177276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:17.405004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:17.413204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1621026e-5dde-433e-811a-c71cfc02876e tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.265306 Sep 26 10:38:17.414698 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 361/743] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:17 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:18.407134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-df465d74-2aad-4934-be5e-a461ddc25b4c req-9157dc3d-281d-4a44-8583-c0be23dc84b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a0d990-0849-4bdf-b998-46ef72a35795", "name": "network-vif-plugged", "status": "completed", "tag": "8381e42d-d3f3-48fb-ac13-b807cee6c194"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:18.422059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-df465d74-2aad-4934-be5e-a461ddc25b4c req-9157dc3d-281d-4a44-8583-c0be23dc84b2 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:18.422841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-df465d74-2aad-4934-be5e-a461ddc25b4c req-9157dc3d-281d-4a44-8583-c0be23dc84b2 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:18.429762 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-df465d74-2aad-4934-be5e-a461ddc25b4c req-9157dc3d-281d-4a44-8583-c0be23dc84b2 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:18.436600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:18.437823 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:18.453845 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:18.456856 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:18.459010 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:18.460006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:18.460638 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:18.461908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:18.492030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-df465d74-2aad-4934-be5e-a461ddc25b4c req-9157dc3d-281d-4a44-8583-c0be23dc84b2 service nova] Creating event network-vif-plugged:8381e42d-d3f3-48fb-ac13-b807cee6c194 for instance 86a0d990-0849-4bdf-b998-46ef72a35795 on hv-cinder-84456 Sep 26 10:38:18.511062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-df465d74-2aad-4934-be5e-a461ddc25b4c req-9157dc3d-281d-4a44-8583-c0be23dc84b2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107592 Sep 26 10:38:18.517080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 383/744] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:18.996338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:19.013535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4bb1d506-e8d0-4658-befc-fa227bed2f38 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.580753 Sep 26 10:38:19.015086 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 362/745] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:18 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:20.045744 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:20.047691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:20.056442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:20.057203 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:20.057911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:20.059118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:20.060899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:20.060899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:20.323931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:20.339687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-59e2fc69-95cf-4e76-b5ef-0b9331fbb7f4 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1365 microversion: 2.1 time: 0.305320 Sep 26 10:38:20.345027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 384/746] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:20 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:21.373391 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:21.374039 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:21.381258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:21.382148 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:21.383484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:21.384237 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:21.384730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:21.385332 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:21.547470 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:21.555500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5a8a85f2-ed74-4d2a-8575-4ca8d3bd5c59 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1556 microversion: 2.1 time: 0.186553 Sep 26 10:38:21.556153 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 363/747] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:21 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1556 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:21.578791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:21.579890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:21.589453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:21.589453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:21.589453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:21.589453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:21.589862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:21.590709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:21.680196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-15b81a3a-0e43-4f68-9957-4d9f0d56b3bf tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105630 Sep 26 10:38:21.680873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 385/748] 10.222.0.49 () {58 vars in 1275 bytes} [Mon Sep 26 10:38:21 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:21.735281 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a693a355-9f26-4869-bcaf-11f18a46075e tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Action: 'create', calling method: .version_select at 0x7fbadb19eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1012251894", "metadata": {"Type": "work"}}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:22.095194 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a693a355-9f26-4869-bcaf-11f18a46075e tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.504662 Sep 26 10:38:22.096454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 364/749] 10.222.0.49 () {60 vars in 1156 bytes} [Mon Sep 26 10:38:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 506 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 26 10:38:22.111375 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c090c960-4918-49ba-aa78-3bfd9a37fbb5 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Calling method '.version_select at 0x7fbadb101e50>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:22.163796 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c090c960-4918-49ba-aa78-3bfd9a37fbb5 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c" status: 200 len: 353 microversion: 2.1 time: 0.056490 Sep 26 10:38:22.170548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 386/750] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:38:22 2022] GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:22.978004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-167e180b-a2ed-4fb9-8ed8-e4afdecb099a req-d2640e3d-e17f-4c2e-be0c-998cd7e91d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a0d990-0849-4bdf-b998-46ef72a35795", "tag": "8381e42d-d3f3-48fb-ac13-b807cee6c194"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:22.990492 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-167e180b-a2ed-4fb9-8ed8-e4afdecb099a req-d2640e3d-e17f-4c2e-be0c-998cd7e91d6c service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:22.991191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-167e180b-a2ed-4fb9-8ed8-e4afdecb099a req-d2640e3d-e17f-4c2e-be0c-998cd7e91d6c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:22.991978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-167e180b-a2ed-4fb9-8ed8-e4afdecb099a req-d2640e3d-e17f-4c2e-be0c-998cd7e91d6c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:23.003534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-167e180b-a2ed-4fb9-8ed8-e4afdecb099a req-d2640e3d-e17f-4c2e-be0c-998cd7e91d6c service nova] Creating event network-changed:8381e42d-d3f3-48fb-ac13-b807cee6c194 for instance 86a0d990-0849-4bdf-b998-46ef72a35795 on hv-cinder-84456 Sep 26 10:38:23.009577 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-167e180b-a2ed-4fb9-8ed8-e4afdecb099a req-d2640e3d-e17f-4c2e-be0c-998cd7e91d6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036772 Sep 26 10:38:23.010866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 365/751] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:23.179430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ef4e2eab-4eec-4bdd-9b36-cea73a38ad74 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Calling method '.version_select at 0x7fbadb15f160>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:23.260317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ef4e2eab-4eec-4bdd-9b36-cea73a38ad74 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c" status: 200 len: 354 microversion: 2.1 time: 0.085716 Sep 26 10:38:23.260913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 387/752] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:38:23 2022] GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:23.277244 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-edafad4d-0b4b-4784-8bff-290217393217 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Calling method '.version_select at 0x7fbadb0314c0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:23.355774 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-edafad4d-0b4b-4784-8bff-290217393217 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c" status: 200 len: 354 microversion: 2.1 time: 0.084981 Sep 26 10:38:23.356560 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 366/753] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:38:23 2022] GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:23.376885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d9be9a86-7009-4c6a-a59b-9cd7ad0afd68 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Calling method '.version_select at 0x7fbadb1861f0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:23.473742 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d9be9a86-7009-4c6a-a59b-9cd7ad0afd68 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c" status: 202 len: 0 microversion: 2.1 time: 0.101691 Sep 26 10:38:23.475382 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 388/754] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:38:23 2022] DELETE /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:23.486897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2f65edc7-2a56-4d0a-b44a-6f0bc73b0a51 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Calling method '.version_select at 0x7fbadb19e9d0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:23.551490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2f65edc7-2a56-4d0a-b44a-6f0bc73b0a51 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c" status: 200 len: 353 microversion: 2.1 time: 0.072094 Sep 26 10:38:23.552591 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 367/755] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:38:23 2022] GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:24.566593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-77120dc4-9fdd-4353-9813-dadf99e0c628 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Calling method '.version_select at 0x7fbadb1015e0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:24.607927 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-77120dc4-9fdd-4353-9813-dadf99e0c628 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] HTTP exception thrown: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-77120dc4-9fdd-4353-9813-dadf99e0c628 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Request method failure captured: Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c HTTP/1.1 Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYEdtqQB7zqrSuQDTZqnhk8Ty35jkmHReOg4gkqiHleocDFXKgD9yyAZq67656RGqT6sXewck5hdTnObLKG3wGqQp2FROLVgJz1NHgJWEuu0YTSRKnzGw_87mFP-qb3hu6ln3DvSMF7ZCRxJoElPSWhWMMK01qV0L2qszTeZs36pKT4 Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 1219307a321f438c8efa9f1268974e6e Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesGetTestJSON-1051062204 Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:24.609982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1219307a321f438c8efa9f1268974e6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1219307a321f438c8efa9f1268974e6e", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1219307a321f438c8efa9f1268974e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1219307a321f438c8efa9f1268974e6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesGetTestJSON-1051062204 Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 1219307a321f438c8efa9f1268974e6e Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesGetTestJSON-1051062204 Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesGetTestJSON-1051062204-project Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 3d79db1ac5f14d908ea33c02f12a721d Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesGetTestJSON-1051062204-project Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': 'b653516a-c279-4162-a1a8-5366e14d108c'} Sep 26 10:38:24.611626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. (HTTP 404) (Request-ID: req-dc45fa76-1156-45b0-93b5-14c9611bc12c) Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:24.612623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 26 10:38:24.614059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 26 10:38:24.615407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. Sep 26 10:38:24.616746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:24.618499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-77120dc4-9fdd-4353-9813-dadf99e0c628 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] Returning 404 to user: Volume b653516a-c279-4162-a1a8-5366e14d108c could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:24.619342 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-77120dc4-9fdd-4353-9813-dadf99e0c628 tempest-VolumesGetTestJSON-1051062204 tempest-VolumesGetTestJSON-1051062204-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c" status: 404 len: 109 microversion: 2.1 time: 0.057375 Sep 26 10:38:24.619886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 389/756] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:38:24 2022] GET /compute/v2.1/os-volumes/b653516a-c279-4162-a1a8-5366e14d108c => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:26.413780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:26.414462 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:26.421043 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:26.421451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:26.421880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:26.422596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:26.423044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:26.423458 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:26.446355 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-334f1e6a-9208-454c-9f1a-1f43a7a9997d tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/ips" status: 200 len: 146 microversion: 2.1 time: 0.036877 Sep 26 10:38:26.446983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 368/757] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:38:26 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:27.792805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b509f1-4757-4c60-8141-8de9071b2235"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:27.795379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:27.803098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:27.803829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:27.804352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:27.805129 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:27.805587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:27.806014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:28.054754 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:28.055380 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:28.055977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-289e1b63-3b7f-404c-bcb8-03ac7f2dc391 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268059 Sep 26 10:38:28.056645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 390/758] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:38:27 2022] POST /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:38:28.061622 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:28.062314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:28.062927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:28.063807 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:28.064425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:28.065205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:28.094123 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c3ce7cfc-8715-4cb7-bb1a-02e248f805ca tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/ips" status: 200 len: 152 microversion: 2.20 time: 0.043724 Sep 26 10:38:28.094658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 369/759] 10.222.0.49 () {60 vars in 1289 bytes} [Mon Sep 26 10:38:28 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 26 10:38:30.188519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:30.189166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:30.196331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:30.196857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:30.197282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:30.198135 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:30.198602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:30.199025 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:30.223651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lazy-loading 'flavor' on Instance uuid 0e17bf82-8d15-4e83-a313-89a8126ff033 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:30.440169 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fcfe121e-5add-4bcb-8dff-abaa343649b5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/action" status: 202 len: 0 microversion: 2.20 time: 0.256208 Sep 26 10:38:30.440885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 391/760] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 10:38:30 2022] POST /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:38:30.455365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:30.456225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:30.464499 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:30.465064 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:30.465566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:30.466364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:30.466978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:30.470636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:30.607452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:30.616138 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:30.617592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:30.618772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5c461f20-d1eb-4a15-8163-aa6f9fd21d50 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.172930 Sep 26 10:38:30.619381 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 370/761] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:30 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:38:31.645596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:31.646322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:31.653264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:31.653746 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:31.654207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:31.654896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:31.655345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:31.655797 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:31.796317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:31.808094 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:31.809541 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:31.810787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fdc61ed8-0be0-4186-8b93-409764394119 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.169997 Sep 26 10:38:31.811339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 392/762] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:31 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:32.836100 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:32.836712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:32.843114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:32.843595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:32.844038 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:32.844728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:32.845180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:32.845604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:32.978460 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:32.987255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:32.988740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:32.990793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-311e3a2d-2f9b-4a9c-bdc9-a606d903cfbb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.158638 Sep 26 10:38:32.991354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 371/763] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:32 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:34.016596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:34.017292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:34.023784 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:34.024272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:34.024711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:34.025402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:34.025857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:34.026315 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:34.194266 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:34.199104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:34.207019 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:34.209255 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:34.210463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ef2c591d-2c69-4be4-8276-cf756dc5acd8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.197855 Sep 26 10:38:34.211199 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 393/764] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:34 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:35.239532 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:35.240288 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:35.249222 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:35.249816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:35.250283 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:35.251159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:35.251693 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:35.252122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:35.390952 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:35.400325 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:35.401820 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:35.403008 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a392b2ec-a3e3-4909-a19f-d3ddec66e3f2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.167846 Sep 26 10:38:35.403562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 372/765] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:35 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:35.631429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:35.633563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:35.640478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:35.640961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:35.641394 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:35.642098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:35.642550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:35.642969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:35.672508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8fcb9ca2-400e-453b-b150-224b079808c5 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Sep 26 10:38:35.673068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 394/766] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:35 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:35.684347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:35.684832 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:35.690760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:35.691242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:35.691671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:35.692349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:35.693348 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:35.693763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:35.723635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7e3d3026-84b4-41e3-b83d-ca3a8a0eda76 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/d4b509f1-4757-4c60-8141-8de9071b2235" status: 200 len: 194 microversion: 2.1 time: 0.043028 Sep 26 10:38:35.724215 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 373/767] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 10:38:35 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/d4b509f1-4757-4c60-8141-8de9071b2235 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:36.429218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:36.430187 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:36.437284 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:36.437775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:36.438345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:36.439125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:36.439610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:36.440071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:36.581513 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:36.591026 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:36.592584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:36.593886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-32a013c1-eac1-49d9-b59f-47c98534ad9e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.169318 Sep 26 10:38:36.594807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 395/768] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:36 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:38:37.108629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a425bb4a-3ba9-4a37-905f-e85511fcb1c9"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:37.112294 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:37.120686 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:37.121452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:37.122755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:37.123685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:37.124963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:37.125595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:37.390524 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-75dcd532-2920-4ff7-b62e-b6a64c85973c tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "POST /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286750 Sep 26 10:38:37.391577 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 374/769] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:38:37 2022] POST /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:37.621230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:37.622636 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:37.629201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:37.629686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:37.630181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:37.630873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:37.631323 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:37.631741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:37.765871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:37.775301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:37.776741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:37.777951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6c202931-c3ec-4a4c-b697-f1d56d2b4b48 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.160523 Sep 26 10:38:37.778539 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 396/770] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:37 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:38.806106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:38.807259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:38.813017 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:38.813498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:38.813927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:38.814637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:38.815088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:38.815511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:38.947592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:38.955579 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:38.957013 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:38.958192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3cfd1f35-c882-48f1-8c38-b399ec5d5414 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.157406 Sep 26 10:38:38.958742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 375/771] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:38 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:39.984272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:39.984848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:39.987264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=45 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:39.993080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:39.993515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:39.993952 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:39.994666 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:39.995122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:39.995546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:40.121707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:40.129618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:40.131096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:40.132239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6a0ff921-0d9b-4693-ac4f-5249cbde2fe8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.152163 Sep 26 10:38:40.132869 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 397/772] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:39 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:41.158120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:41.158726 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:41.165620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:41.166122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:41.166554 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:41.167236 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:41.167689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:41.168110 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:41.292544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:41.300330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:41.301765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:41.302957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0707556c-c4d2-4cb7-9654-02a21262487e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.148772 Sep 26 10:38:41.303512 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 376/773] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:41 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:42.328640 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:42.329282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:42.336231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:42.336717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:42.337155 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:42.337840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:42.338326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:42.338760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:42.472610 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:42.481352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:42.482841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:42.483994 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4d19f24d-b9b4-4ffb-93f1-4e0fe2831ff0 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.159300 Sep 26 10:38:42.484551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 398/774] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:42 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:43.508600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:43.509209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:43.515543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:43.516015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:43.516446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:43.517120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:43.517567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:43.517987 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:43.521875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:43.648143 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:43.656103 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:43.657535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:43.658711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5b10e501-87d7-4436-aff0-3d0919b9d785 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.154033 Sep 26 10:38:43.659271 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 377/775] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:43 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:44.684649 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:44.685404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:44.691717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:44.692201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:44.692641 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:44.693329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:44.693825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:44.694280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:44.825795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:44.833866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:44.835860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:44.837018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f1776713-e194-4f24-9245-4267fd32ac99 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.156283 Sep 26 10:38:44.837582 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 399/776] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:44 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:44.942495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:44.945193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:44.947437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:44.952759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:44.953280 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:44.953721 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:44.954456 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:44.954914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:44.955341 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:44.986195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9844198e-c88b-43fd-ba8b-d315f9957ab6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047474 Sep 26 10:38:44.986741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 378/777] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:44 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:45.136146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:45.136592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:45.142593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:45.143082 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:45.143520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:45.144202 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:45.144687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:45.145107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:45.174929 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-53c8094d-c91a-4c49-88b5-c791bab02d29 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/d4b509f1-4757-4c60-8141-8de9071b2235" status: 200 len: 194 microversion: 2.1 time: 0.043265 Sep 26 10:38:45.175534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 400/778] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 10:38:45 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/d4b509f1-4757-4c60-8141-8de9071b2235 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:45.186009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:45.186523 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:45.192644 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:45.193130 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:45.193565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:45.194825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:45.195316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:45.195741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:45.281755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lazy-loading 'services' on Instance uuid 81811a93-acfd-43d2-a99f-a4a1f54c4b60 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:45.353407 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-05d47f25-56a7-469e-9ded-2679c4f75021 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/d4b509f1-4757-4c60-8141-8de9071b2235" status: 202 len: 0 microversion: 2.1 time: 0.171238 Sep 26 10:38:45.355670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 379/779] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:38:45 2022] DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/d4b509f1-4757-4c60-8141-8de9071b2235 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:45.863311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:45.863952 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:45.871166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:45.871651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:45.872083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:45.872775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:45.873225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:45.873646 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:46.077690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:46.086334 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:46.087794 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:46.088963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7f3b5890-4c02-476d-9d3c-23c63ab0b09c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.229585 Sep 26 10:38:46.089523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 401/780] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:45 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:47.119192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:47.120029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:47.126543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:47.127013 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:47.127517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:47.128306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:47.128782 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:47.129199 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:47.264943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:47.273534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:47.275009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:47.276166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ce3a8f51-7222-4d40-9099-e5255970343d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1745 microversion: 2.20 time: 0.162557 Sep 26 10:38:47.276946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 380/781] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:47 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:47.541937 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:47.542468 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:47.549006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:47.549492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:47.549931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:47.550647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:47.551106 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:47.551535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:47.580560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-746f25f1-c553-4962-a8f6-2a7484adf233 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/a425bb4a-3ba9-4a37-905f-e85511fcb1c9" status: 200 len: 194 microversion: 2.1 time: 0.042552 Sep 26 10:38:47.581136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 402/782] 10.222.0.49 () {58 vars in 1413 bytes} [Mon Sep 26 10:38:47 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/a425bb4a-3ba9-4a37-905f-e85511fcb1c9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:47.591691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:47.592187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:47.598728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:47.599258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:47.599695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:47.600412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:47.600868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:47.601289 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:47.680187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lazy-loading 'services' on Instance uuid 81811a93-acfd-43d2-a99f-a4a1f54c4b60 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:47.751102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-578fc7b1-8dca-42d2-872f-87c644db73d6 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/a425bb4a-3ba9-4a37-905f-e85511fcb1c9" status: 202 len: 0 microversion: 2.1 time: 0.163145 Sep 26 10:38:47.751686 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 381/783] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:38:47 2022] DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments/a425bb4a-3ba9-4a37-905f-e85511fcb1c9 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:48.303272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:48.304490 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:48.315483 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:48.316652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:48.317140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:48.318662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:48.319412 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:48.320316 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:48.470831 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:48.479624 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:48.481361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:48.482591 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-26d060a4-f296-4d4f-b052-2c4feb23d8ed tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1745 microversion: 2.20 time: 0.184329 Sep 26 10:38:48.483156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 403/784] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:48 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:48.931516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:48.933933 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:48.940272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:48.940756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:48.941193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:48.941885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:48.942367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:48.942794 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:48.973575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b1e27dcc-7070-4e4e-aa39-c7b88b7b3723 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047038 Sep 26 10:38:48.974353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 382/785] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:48 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:38:49.092353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:49.094525 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:49.100900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.101390 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.101832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.102573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.103030 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.103454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.135516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-347ec23c-0e26-4530-9a9b-432c0b07fbc4 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047028 Sep 26 10:38:49.136081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 404/786] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:38:49 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:38:49.203389 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:49.204301 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:49.213500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.214275 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.214913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.215617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.216094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.216484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.245412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:38:49.345126 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b2777e67-81ec-483f-93b8-3e6d05d7c2ce tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 204 len: 0 microversion: 2.1 time: 0.147507 Sep 26 10:38:49.346497 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 383/787] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:38:49 2022] DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:38:49.355917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:49.356948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:49.367160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.367946 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.368484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.369429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.370278 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.370938 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.508961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:49.509968 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:49.519903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.520661 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.521316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.522972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:49.523849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:49.524450 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:49.537734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:49.547043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0745737c-f627-41c6-82c8-8f7e13ebb70a tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1669 microversion: 2.1 time: 0.196327 Sep 26 10:38:49.549759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 405/788] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:49 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:49.752931 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:49.765844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:49.767470 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:49.768628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3d29e957-1ebf-4a20-9b6d-994b88be17e9 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.264489 Sep 26 10:38:49.769380 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 384/789] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:49 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:38:50.580875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:50.583104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:50.596891 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:50.597780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:50.598562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:50.600208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:50.601689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:50.604809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:50.729689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-d0531f16-269f-4308-b27b-404caeae438c req-48fb90d0-f1e8-42a9-be57-420bb45807f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "name": "network-vif-plugged", "status": "completed", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:50.741288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-d0531f16-269f-4308-b27b-404caeae438c req-48fb90d0-f1e8-42a9-be57-420bb45807f8 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:50.742388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-d0531f16-269f-4308-b27b-404caeae438c req-48fb90d0-f1e8-42a9-be57-420bb45807f8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:50.743080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-d0531f16-269f-4308-b27b-404caeae438c req-48fb90d0-f1e8-42a9-be57-420bb45807f8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:50.758580 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-d0531f16-269f-4308-b27b-404caeae438c req-48fb90d0-f1e8-42a9-be57-420bb45807f8 service nova] Creating event network-vif-plugged:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:38:50.764623 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-d0531f16-269f-4308-b27b-404caeae438c req-48fb90d0-f1e8-42a9-be57-420bb45807f8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235729 Sep 26 10:38:50.765488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 406/790] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:50.785704 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:50.798464 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-935b08c6-dc45-42c0-b7a0-2a7b1dfe97f7 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1669 microversion: 2.1 time: 0.221533 Sep 26 10:38:50.801764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 385/791] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:50 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:38:50.807009 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:50.807717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:50.814552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:50.815236 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:50.815683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:50.816386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:50.816840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:50.817443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:50.977864 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:50.987988 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:50.989632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:50.990954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-84db6151-7fb3-4bb8-8eda-8678e815f856 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.188707 Sep 26 10:38:50.991749 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 407/792] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:50 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:51.824157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:51.824775 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:51.836556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:51.837062 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:51.837492 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:51.838884 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:51.839561 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:51.843048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:52.029530 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:52.030456 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:52.049537 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:52.049934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:52.050397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:52.063397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:52.063893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:52.064335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:52.507848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:52.509629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:52.519556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:52.526985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3d1f75dd-3238-44d6-bc50-efd1a7d27eee tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1669 microversion: 2.1 time: 0.707839 Sep 26 10:38:52.542052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 386/793] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:51 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1669 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:52.542256 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:52.542256 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2bbe2f29-fb9f-45b0-8d0d-8e9d9875a4fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.509166 Sep 26 10:38:52.555207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 408/794] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:52 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:38:53.092040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-41034480-dc4a-4c55-988c-a600e9985ff3 req-c7164b24-60d7-49e7-be71-e3f3b33a34c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81811a93-acfd-43d2-a99f-a4a1f54c4b60", "name": "network-vif-deleted", "tag": "f6d3b71f-a23a-4160-8219-9acd1b33b609"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:53.131114 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-41034480-dc4a-4c55-988c-a600e9985ff3 req-c7164b24-60d7-49e7-be71-e3f3b33a34c6 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:53.132335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-41034480-dc4a-4c55-988c-a600e9985ff3 req-c7164b24-60d7-49e7-be71-e3f3b33a34c6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:53.135301 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-41034480-dc4a-4c55-988c-a600e9985ff3 req-c7164b24-60d7-49e7-be71-e3f3b33a34c6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:53.179800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-41034480-dc4a-4c55-988c-a600e9985ff3 req-c7164b24-60d7-49e7-be71-e3f3b33a34c6 service nova] Creating event network-vif-deleted:f6d3b71f-a23a-4160-8219-9acd1b33b609 for instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 on hv-cinder-84456 Sep 26 10:38:53.200008 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-41034480-dc4a-4c55-988c-a600e9985ff3 req-c7164b24-60d7-49e7-be71-e3f3b33a34c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112274 Sep 26 10:38:53.203343 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 387/795] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:38:53.556246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:53.556863 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:53.567942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:53.568650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:53.570544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:53.571289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:53.571963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:53.572924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:53.573588 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:53.574469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:53.577486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:53.582917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:53.583455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:53.584099 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:53.584567 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:53.585033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:53.624515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:53.625075 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:53.625751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:53.626437 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lazy-loading 'fault' on Instance uuid 81811a93-acfd-43d2-a99f-a4a1f54c4b60 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:38:53.692426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdcfab461e534465a906c0eef201e423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c219db8370d4ef49f235020868144d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:53.707429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-062cb392-a83e-4bb0-b9ff-315781be6edb tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 200 len: 1325 microversion: 2.1 time: 0.156988 Sep 26 10:38:53.739311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 409/796] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:53 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 1325 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:53.940665 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:53.950316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:53.959455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:53.961511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b7402dd2-559e-4483-a507-5322f5c3e350 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.397292 Sep 26 10:38:53.973917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 388/797] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:53 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:38:54.763243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:54.764486 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:54.773117 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:54.773862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:54.775229 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:54.775948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:54.776416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:54.776905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:54.794963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] HTTP exception thrown: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Request method failure captured: Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 HTTP/1.1 Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QAunsfxbY5LZNlg0CcEaoAih1Dbp5rakukzeijcKsJZVJj9-nZv3JlQKMwE6odXg4uuOl0oyLxNGODUUqyLj0jyR9f87zJrNSbTI1Fbeeg5aQ-MaCZXRVYuRbL9_askU1rDklSuZrpzwjEKIwLUeamM67Bkq_SpyisFX47UCcDBc Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:54.799833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c219db8370d4ef49f235020868144d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c219db8370d4ef49f235020868144d7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: cdcfab461e534465a906c0eef201e423 Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:54.801523 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '81811a93-acfd-43d2-a99f-a4a1f54c4b60'} Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:54.802347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:54.803754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:54.806159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Returning 404 to user: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:54.808020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-296c7cc7-f10d-4193-aa0a-9e2b5567b240 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 404 len: 111 microversion: 2.1 time: 0.050440 Sep 26 10:38:54.812553 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 410/798] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:54 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:54.822885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cbb66c47-1625-46a3-85a9-c5d82a48ec44 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '.version_select at 0x7fbadb146dc0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:54.853723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cbb66c47-1625-46a3-85a9-c5d82a48ec44 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810234085" status: 202 len: 0 microversion: 2.1 time: 0.038808 Sep 26 10:38:54.858157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 389/799] 10.222.0.49 () {58 vars in 1221 bytes} [Mon Sep 26 10:38:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810234085 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:38:55.011811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:55.012740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:55.027062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:55.028220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:55.028940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:55.031524 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:55.032699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:55.034352 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:55.086415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=100 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:55.377926 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:55.386991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:55.388460 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:55.389638 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-97fadd0d-ee0e-41d4-ab98-810bc83eb6fd tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.382745 Sep 26 10:38:55.390239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 411/800] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:55 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:56.422978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:56.436424 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:56.453402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:56.454230 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:56.454894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:56.455983 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:56.456631 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:56.457246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:56.671519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:56.686905 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:56.689793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:56.691141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c1612d1c-06d6-455c-8e44-a7cf9f246deb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.272813 Sep 26 10:38:56.692257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 390/801] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:56 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:57.717626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:57.718386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:57.729372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:57.729867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:57.730810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:57.731738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:57.732207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:57.732640 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:57.891375 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:57.901645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:57.903562 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:57.906050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-15d42c51-9866-4d35-bc10-05fdef4f7013 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.192322 Sep 26 10:38:57.907254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 412/802] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:57 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:38:58.148352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-996446156", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "networks": [{"uuid": "4100a641-533c-49ba-9608-c77b1227d5d8"}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:38:58.194211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:58.195703 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:58.202237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.202989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.203593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.204469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.205371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.206049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.222880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] HTTP exception thrown: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Request method failure captured: Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 HTTP/1.1 Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QAunsfxbY5LZNlg0CcEaoAih1Dbp5rakukzeijcKsJZVJj9-nZv3JlQKMwE6odXg4uuOl0oyLxNGODUUqyLj0jyR9f87zJrNSbTI1Fbeeg5aQ-MaCZXRVYuRbL9_askU1rDklSuZrpzwjEKIwLUeamM67Bkq_SpyisFX47UCcDBc Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:58.224876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c219db8370d4ef49f235020868144d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c219db8370d4ef49f235020868144d7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: cdcfab461e534465a906c0eef201e423 Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.226430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '81811a93-acfd-43d2-a99f-a4a1f54c4b60'} Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:58.227230 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.228512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.229769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] validate_networks() for [('4100a641-533c-49ba-9608-c77b1227d5d8', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:38:58.231797 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Returning 404 to user: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:58.232902 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8d3b0fc7-b407-492d-aac6-c5a6b829f3bc tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 404 len: 111 microversion: 2.1 time: 0.042707 Sep 26 10:38:58.233993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 413/803] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:38:58 2022] DELETE /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:58.242613 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:58.243602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 81811a93-acfd-43d2-a99f-a4a1f54c4b60] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:58.250060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.250745 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.251292 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.252415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.252985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.253536 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.271431 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] HTTP exception thrown: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Request method failure captured: Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 HTTP/1.1 Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QAunsfxbY5LZNlg0CcEaoAih1Dbp5rakukzeijcKsJZVJj9-nZv3JlQKMwE6odXg4uuOl0oyLxNGODUUqyLj0jyR9f87zJrNSbTI1Fbeeg5aQ-MaCZXRVYuRbL9_askU1rDklSuZrpzwjEKIwLUeamM67Bkq_SpyisFX47UCcDBc Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:58.273427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c219db8370d4ef49f235020868144d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c219db8370d4ef49f235020868144d7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: cdcfab461e534465a906c0eef201e423 Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.275823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '81811a93-acfd-43d2-a99f-a4a1f54c4b60'} Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:58.276705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. Sep 26 10:38:58.278143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:58.280207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Returning 404 to user: Instance 81811a93-acfd-43d2-a99f-a4a1f54c4b60 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:58.280207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-68b83abf-8c34-4312-85d2-a7c9903a9752 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60" status: 404 len: 111 microversion: 2.1 time: 0.038263 Sep 26 10:38:58.283303 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 414/804] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:58 2022] GET /compute/v2.1/servers/81811a93-acfd-43d2-a99f-a4a1f54c4b60 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:58.784131 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:38:58.784557 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:38:58.785030 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:38:58.785443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:38:58.785899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:38:58.803166 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.804586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.805264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.806101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.807050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.807721 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.825625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Getting quotas for project 3e71ac778bf24f779d6d4c8c5de7e528. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:38:58.829745 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Getting quotas for user 57fa5ee68e6f48e982c312e6bb3a6ce6 and project 3e71ac778bf24f779d6d4c8c5de7e528. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:38:58.843136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:38:58.845684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:38:58.895661 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5512932b-f16c-4472-9f66-7d5a9b64eae5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751108 Sep 26 10:38:58.902505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 391/805] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:38:58.908519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ca5a0aa0-e023-4682-bb14-3aa32ef3e9ce tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:58.909325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ca5a0aa0-e023-4682-bb14-3aa32ef3e9ce tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:58.948538 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:58.949609 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:58.959129 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.959619 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.960088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.960802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:58.961252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:58.961674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:58.974340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ca5a0aa0-e023-4682-bb14-3aa32ef3e9ce tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:58.984081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ca5a0aa0-e023-4682-bb14-3aa32ef3e9ce tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1218 microversion: 2.1 time: 0.080106 Sep 26 10:38:58.985319 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 415/806] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:58 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:38:59.131236 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:59.140760 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:59.142255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:38:59.143443 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-05e7d19e-b57e-4a4c-99c1-bc211f1e5e2b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.208312 Sep 26 10:38:59.144012 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 392/807] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:38:58 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:38:59.476789 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:59.477711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:59.485898 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:59.487049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:59.487711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:59.489311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:59.489995 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:59.490669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:59.509701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] HTTP exception thrown: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Request method failure captured: Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 HTTP/1.1 Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_QAunsfxbY5LZNlg0CcEaoAih1Dbp5rakukzeijcKsJZVJj9-nZv3JlQKMwE6odXg4uuOl0oyLxNGODUUqyLj0jyR9f87zJrNSbTI1Fbeeg5aQ-MaCZXRVYuRbL9_askU1rDklSuZrpzwjEKIwLUeamM67Bkq_SpyisFX47UCcDBc Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:38:59.512210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c219db8370d4ef49f235020868144d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c219db8370d4ef49f235020868144d7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: cdcfab461e534465a906c0eef201e423 Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.513625 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '9ca6fe02-8975-4daa-a713-5ec2520b2d67'} Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:59.514397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.515656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.518500 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Returning 404 to user: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:59.519480 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e70f109f-3959-4a7a-a126-919aafbac2b9 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 404 len: 111 microversion: 2.1 time: 0.047149 Sep 26 10:38:59.522910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 416/808] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:38:59 2022] DELETE /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:38:59.529547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:38:59.530880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] [instance: 9ca6fe02-8975-4daa-a713-5ec2520b2d67] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:38:59.542085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:59.543015 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:59.543803 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:59.544808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:38:59.545393 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:38:59.545842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:38:59.550602 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:38:59.564096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] HTTP exception thrown: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Request method failure captured: Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 HTTP/1.1 Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_QAunsfxbY5LZNlg0CcEaoAih1Dbp5rakukzeijcKsJZVJj9-nZv3JlQKMwE6odXg4uuOl0oyLxNGODUUqyLj0jyR9f87zJrNSbTI1Fbeeg5aQ-MaCZXRVYuRbL9_askU1rDklSuZrpzwjEKIwLUeamM67Bkq_SpyisFX47UCcDBc Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:38:59.566164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3c219db8370d4ef49f235020868144d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3c219db8370d4ef49f235020868144d7", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3c219db8370d4ef49f235020868144d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 3c219db8370d4ef49f235020868144d7 Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1711285487 Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: cdcfab461e534465a906c0eef201e423 Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeTestJSON-1711285487-project Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.567490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '9ca6fe02-8975-4daa-a713-5ec2520b2d67'} Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:38:59.568211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. Sep 26 10:38:59.569985 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:38:59.572543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] Returning 404 to user: Instance 9ca6fe02-8975-4daa-a713-5ec2520b2d67 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:38:59.573594 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8ba0b6d4-cd93-4814-a22f-222c52bb1922 tempest-AttachVolumeTestJSON-1711285487 tempest-AttachVolumeTestJSON-1711285487-project] 10.222.0.49 "GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67" status: 404 len: 111 microversion: 2.1 time: 0.048702 Sep 26 10:38:59.575239 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 393/809] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:38:59 2022] GET /compute/v2.1/servers/9ca6fe02-8975-4daa-a713-5ec2520b2d67 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:00.010275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:00.010838 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:00.017338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:00.017832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:00.018300 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:00.019011 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:00.019474 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:00.019900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:00.104990 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:00.113534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-10acff73-ea4a-417f-8d8c-d2c7cb5dbee1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1270 microversion: 2.1 time: 0.107723 Sep 26 10:39:00.114432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 417/810] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:00 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1270 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:00.172893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:00.173906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:00.180730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:00.181235 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:00.181664 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:00.182397 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:00.182849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:00.183266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:00.509320 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:00.519485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:00.521754 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:00.523509 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7a80b16c-ee1b-4334-a60d-24f501d4bd0d tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1740 microversion: 2.20 time: 0.355597 Sep 26 10:39:00.538292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 394/811] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:00 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:01.137018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:01.137612 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:01.144531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:01.145029 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:01.145501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:01.146245 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:01.146707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:01.147137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:01.319144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:01.327392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-88868903-6d7f-4a3c-99c3-d23f998611fb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1276 microversion: 2.1 time: 0.194145 Sep 26 10:39:01.327967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 418/812] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:01 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:01.553159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:01.554493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:01.568184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:01.568928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:01.569930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:01.570685 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:01.571134 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:01.571553 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:01.993627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:02.001702 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:02.003316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:02.004575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-12db60bc-5ba7-4ec3-b95e-ede80c197f74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1722 microversion: 2.20 time: 0.458066 Sep 26 10:39:02.005151 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 395/813] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:01 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:02.352033 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:02.352741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:02.359449 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:02.359941 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:02.360383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:02.361087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:02.361605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:02.362050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:02.649078 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:02.657300 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-54135590-bf6c-4ec1-9930-e861a96f37b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.309669 Sep 26 10:39:02.657967 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 419/814] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:02 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:03.033034 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:03.034868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:03.044806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:03.045614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:03.046448 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:03.047348 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:03.048208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:03.048792 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:03.282404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:03.292209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:03.293699 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:03.294902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d398ce8d-6961-4804-8a31-6db570d8cd77 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1722 microversion: 2.20 time: 0.266797 Sep 26 10:39:03.310376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 396/815] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:03 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:03.405704 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-dabad25e-dd36-4ac3-8dad-20bf10c817d4 req-e0db1204-ee4c-4810-8843-12863b96eee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13f34933-c3cd-4b26-86c2-1fbee79f4fbe", "tag": "57839eaf-1949-4800-a7dc-981dea02ad7e"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:03.415819 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-dabad25e-dd36-4ac3-8dad-20bf10c817d4 req-e0db1204-ee4c-4810-8843-12863b96eee7 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:03.416627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-dabad25e-dd36-4ac3-8dad-20bf10c817d4 req-e0db1204-ee4c-4810-8843-12863b96eee7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:03.417295 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-dabad25e-dd36-4ac3-8dad-20bf10c817d4 req-e0db1204-ee4c-4810-8843-12863b96eee7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:03.429225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-dabad25e-dd36-4ac3-8dad-20bf10c817d4 req-e0db1204-ee4c-4810-8843-12863b96eee7 service nova] Creating event network-changed:57839eaf-1949-4800-a7dc-981dea02ad7e for instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe on hv-cinder-84456 Sep 26 10:39:03.435110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-dabad25e-dd36-4ac3-8dad-20bf10c817d4 req-e0db1204-ee4c-4810-8843-12863b96eee7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033308 Sep 26 10:39:03.436309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 420/816] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:03.683232 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:03.683962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:03.689806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:03.690337 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:03.690777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:03.691467 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:03.691920 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:03.692346 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:03.829719 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:03.838111 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5ee2e9cb-cf5a-4c54-bcf5-f819a10c7ccf tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.159375 Sep 26 10:39:03.838679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 397/817] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:03 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:04.335228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:04.336035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:04.344040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.345210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.345867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:04.346632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.347151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.347685 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:04.523167 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:04.532555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:04.534462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:04.535811 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4ce2b55e-8ba2-4e5c-8062-234190584098 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1725 microversion: 2.20 time: 0.217621 Sep 26 10:39:04.537286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 421/818] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:04 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:04.564046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0a0aac5-1a84-4e27-a4d7-128764881e46"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:04.566701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:04.573708 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.574588 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.575278 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:04.576203 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.576873 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.577511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:04.613039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-39b6a071-205b-4a91-b92e-5b8563e09946 req-8ceca09c-dfab-49fe-8bd3-aefdfae04cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "name": "network-vif-unplugged", "status": "completed", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:04.644619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-39b6a071-205b-4a91-b92e-5b8563e09946 req-8ceca09c-dfab-49fe-8bd3-aefdfae04cb0 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.645107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-39b6a071-205b-4a91-b92e-5b8563e09946 req-8ceca09c-dfab-49fe-8bd3-aefdfae04cb0 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.645768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-39b6a071-205b-4a91-b92e-5b8563e09946 req-8ceca09c-dfab-49fe-8bd3-aefdfae04cb0 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:04.683999 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-39b6a071-205b-4a91-b92e-5b8563e09946 req-8ceca09c-dfab-49fe-8bd3-aefdfae04cb0 service nova] Creating event network-vif-unplugged:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:39:04.692359 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-39b6a071-205b-4a91-b92e-5b8563e09946 req-8ceca09c-dfab-49fe-8bd3-aefdfae04cb0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085293 Sep 26 10:39:04.693605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 422/819] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:04.873722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:04.874491 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:04.896791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.902704 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.903160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:04.903894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:04.904355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:04.904789 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.041962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7e26c745-72e0-4676-82cc-3f9c16b13cec tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.481744 Sep 26 10:39:05.042777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 398/820] 10.222.0.49 () {62 vars in 1364 bytes} [Mon Sep 26 10:39:04 2022] POST /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-volume_attachments => generated 188 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 26 10:39:05.199498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:05.199995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:05.206810 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:05.207306 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:05.207741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.208449 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:05.208903 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:05.209324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.387654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:05.399985 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2b69e9ba-88f5-4091-98ce-1ae48e4d5248 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.540392 Sep 26 10:39:05.401847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 423/821] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:04 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:39:05.503271 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-df79b773-7e31-4897-95d1-d1e5911262d2 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-volume_attachments/c0a0aac5-1a84-4e27-a4d7-128764881e46" status: 202 len: 0 microversion: 2.20 time: 0.307721 Sep 26 10:39:05.503922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 399/822] 10.222.0.49 () {60 vars in 1457 bytes} [Mon Sep 26 10:39:05 2022] DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-volume_attachments/c0a0aac5-1a84-4e27-a4d7-128764881e46 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 26 10:39:05.566194 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:05.566787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:05.574262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:05.574764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:05.575196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.576302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:05.576758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:05.577180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.621043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127056) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 10:39:05.692955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ec7cd075-7a09-4e5e-8c4a-47b89ddd1f58 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "POST /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/action" status: 202 len: 0 microversion: 2.20 time: 0.131094 Sep 26 10:39:05.693711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 424/823] 10.222.0.49 () {62 vars in 1319 bytes} [Mon Sep 26 10:39:05 2022] POST /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:39:05.701551 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:05.702204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:05.709694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:05.711048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:05.711837 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.712313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:05.712766 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:05.713299 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:05.955945 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:05.966181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:05.967740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:05.968914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-35476219-bf17-413f-b732-98479347f7ad tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1673 microversion: 2.20 time: 0.271299 Sep 26 10:39:05.969452 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 400/824] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:05 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1673 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:06.424555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:06.425209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:06.432573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:06.433122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:06.433494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:06.434487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:06.434910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:06.435335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:06.595689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:06.604496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b846e526-ab60-4ae8-b5ec-e6114c701dbb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.184635 Sep 26 10:39:06.605645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 425/825] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:06 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:06.993761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:07.001209 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:07.010314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:07.010814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:07.011271 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:07.011962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:07.012421 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:07.012851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:07.197566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:07.205959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:07.207716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:07.208881 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9f561837-9c7c-4eca-bd79-2254fe9fc5e7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.219051 Sep 26 10:39:07.209444 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 401/826] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:06 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:07.631691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:07.633003 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:07.639764 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:07.640245 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:07.640881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:07.641577 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:07.642045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:07.642725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:07.708938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:07.709727 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:07.716431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:07.716918 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:07.717514 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:07.718438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:07.719549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:07.719549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:07.770147 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b2dc5163-dd8c-4fa1-bbf8-558715a36d5b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/ips" status: 200 len: 151 microversion: 2.1 time: 0.065245 Sep 26 10:39:07.779593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 402/827] 10.222.0.49 () {58 vars in 1248 bytes} [Mon Sep 26 10:39:07 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/ips => generated 151 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:39:07.794162 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:07.809156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ce69acef-b474-49d1-9387-3922eec46ed3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.182670 Sep 26 10:39:07.809825 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 426/828] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:07 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:08.238396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:08.239191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:08.246678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:08.247322 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:08.247778 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:08.248848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:08.249131 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:08.249571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:08.430503 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:08.453180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:08.455314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:08.462383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9ad78c48-c93d-4cb8-9bbe-2a7ed9093cbc tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.224973 Sep 26 10:39:08.464210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 403/829] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:08 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:08.893573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:08.894470 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:08.901325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:08.906553 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:08.908281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:08.912274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:08.914464 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:08.915082 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:08.986995 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:09.128296 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:09.151453 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-401bd775-99ac-4c68-913f-daf5b4858f4e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.262516 Sep 26 10:39:09.157301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 427/830] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:08 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:09.236048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7beda68b-ec7f-4e36-973d-e5e5087ecc02"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:09.238595 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:09.247674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:09.251284 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:09.269866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:09.273085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:09.273710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:09.274484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:09.274948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:09.275414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:09.494779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:09.495684 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:09.507120 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:09.507617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:09.508065 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:09.508780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:09.509240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:09.509670 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:09.806838 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:09.819592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:09.821663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:09.823290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-797422c8-526c-470f-b640-2b92c94b293e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.335022 Sep 26 10:39:09.824282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 428/831] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:09 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:10.184780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:10.186391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:10.190109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:10.197014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:10.197546 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:10.197991 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:10.198755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:10.199398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:10.199833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:10.361360 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:10.370813 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-63ee1421-fe27-465f-875c-51baf771c9b1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.191305 Sep 26 10:39:10.371318 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 429/832] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:10 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:39:10.637366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-2c4ae0ef-613d-46ef-b416-a8853f31018f req-267dd3a5-7701-4f20-92c8-a89fc0ca5125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f34933-c3cd-4b26-86c2-1fbee79f4fbe", "name": "network-vif-plugged", "status": "completed", "tag": "57839eaf-1949-4800-a7dc-981dea02ad7e"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:10.656519 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2c4ae0ef-613d-46ef-b416-a8853f31018f req-267dd3a5-7701-4f20-92c8-a89fc0ca5125 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:10.657505 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2c4ae0ef-613d-46ef-b416-a8853f31018f req-267dd3a5-7701-4f20-92c8-a89fc0ca5125 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:10.668620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2c4ae0ef-613d-46ef-b416-a8853f31018f req-267dd3a5-7701-4f20-92c8-a89fc0ca5125 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:10.688860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-2c4ae0ef-613d-46ef-b416-a8853f31018f req-267dd3a5-7701-4f20-92c8-a89fc0ca5125 service nova] Creating event network-vif-plugged:57839eaf-1949-4800-a7dc-981dea02ad7e for instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe on hv-cinder-84456 Sep 26 10:39:10.696650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-2c4ae0ef-613d-46ef-b416-a8853f31018f req-267dd3a5-7701-4f20-92c8-a89fc0ca5125 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063326 Sep 26 10:39:10.698317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 430/833] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:39:10.851083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:10.852046 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:10.859808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:10.860527 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:10.861226 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:10.862361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:10.863723 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:10.864355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:11.054048 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:11.066739 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:11.068675 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:11.070483 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b509dbe1-05d1-467d-b1d9-df89f3137044 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.224655 Sep 26 10:39:11.078682 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 431/834] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:10 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:11.394943 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:11.396398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:11.403753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:11.404492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:11.404937 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:11.405685 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:11.406221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:11.406654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:11.411228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:11.550243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:11.563881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-88101e99-4b26-4691-af1a-980681599552 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.173551 Sep 26 10:39:11.564728 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 432/835] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:11 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:39:12.096896 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:12.097508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:12.104413 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:12.104908 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:12.105416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:12.106397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:12.106849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:12.107273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:12.256994 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:12.265378 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:12.266997 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:12.268629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-28943e6f-035e-4556-8356-c1ac1228a04e tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.175408 Sep 26 10:39:12.282224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 433/836] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:12 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:39:12.588397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:12.589790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:12.596204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:12.596731 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:12.597131 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:12.597833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:12.598315 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:12.598740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:12.748324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:12.757272 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ea7770f5-34b2-4bdd-b834-daa435a02b22 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.172867 Sep 26 10:39:12.758011 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 434/837] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:12 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:39:13.295709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:13.296645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:13.305012 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:13.305654 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:13.306091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:13.306788 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:13.307240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:13.307657 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:13.452321 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:13.460860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:13.462347 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:13.463518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9d2c9667-0074-49c2-8861-832fee6a0a29 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.172372 Sep 26 10:39:13.464083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 435/838] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:13 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:39:13.782553 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:13.783224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:13.795863 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:13.796406 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:13.796853 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:13.798866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:13.799343 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:13.799777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:14.054302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:14.065528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5709287f-d432-4108-b1c3-b022b64a9b85 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.287684 Sep 26 10:39:14.082560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 436/839] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:13 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:14.493563 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:14.494136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:14.500207 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:14.500699 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:14.501148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:14.501834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:14.502314 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:14.502740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:14.660330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:14.668621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:14.670302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:14.671436 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-47dc7bf3-4289-4d97-bbd0-761679efd853 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.181940 Sep 26 10:39:14.672018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 437/840] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:14 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:39:15.108289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:15.108891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:15.116076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:15.117077 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:15.117712 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:15.118778 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:15.119470 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:15.120258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:15.315604 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:15.324940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-462aa707-36d7-4b8d-adf6-b33a85c3dab1 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.220649 Sep 26 10:39:15.325993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 438/841] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:15 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:15.697903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:15.698662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:15.704778 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:15.706349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:15.707072 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:15.707856 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:15.708385 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:15.708968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:15.854299 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:15.863355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:15.864892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:15.866793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7f05fa64-63b1-4af1-a34c-5a4fcd5e7b6f tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.172174 Sep 26 10:39:15.867406 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 439/842] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:15 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:39:16.315451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=5,nova_cell1:UPDATE=10 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:16.335668 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f35cab81-2553-4f75-95fc-1a5bb559db05 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "POST /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.104328 Sep 26 10:39:16.336272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 404/843] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:39:09 2022] POST /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments => generated 194 bytes in 7106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:16.348145 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:16.348769 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:16.355373 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:16.356403 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:16.356839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:16.357740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:16.358237 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:16.358648 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:16.490099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:16.497708 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8c77bd09-80cd-4826-92e1-594450c46beb tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.153533 Sep 26 10:39:16.498344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 440/844] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:16 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:16.893826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:16.894498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:16.896435 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:16.904359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:16.904878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:16.905374 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:16.906089 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:16.906543 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:16.906978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:17.042961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:17.050995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:17.052440 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:17.053599 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3c9007f3-aae1-4b77-b8bc-b8aeb52e27e3 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.164698 Sep 26 10:39:17.054171 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 405/845] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:16 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:39:17.520881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:17.521489 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:17.528773 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:17.529193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:17.530298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:17.531000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:17.531452 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:17.531886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:17.668183 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:17.676052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2dc7404e-a19c-4668-a055-3db9457c70be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.159132 Sep 26 10:39:17.676618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 441/846] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:17 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:39:18.079219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:18.079849 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:18.087251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:18.087808 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:18.088304 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:18.089154 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:18.089771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:18.090302 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:18.227267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:18.236651 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:18.238251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:18.240225 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-12baf7bf-6f5b-4d47-b0ca-09426c1207d8 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.164807 Sep 26 10:39:18.241160 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 406/847] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:18 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:18.700582 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:18.701196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:18.707597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:18.708085 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:18.708526 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:18.709212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:18.709688 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:18.710201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:18.852665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:18.860616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-283f9b2a-9bc4-4f5a-b34a-82bc2dd780f7 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1318 microversion: 2.1 time: 0.163920 Sep 26 10:39:18.861187 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 442/848] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:18 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:19.427540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:19.428147 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:19.434193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:19.434677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:19.435101 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:19.435783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:19.436227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:19.436643 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:19.570517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:19.580486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:19.582447 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:19.583758 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-34895cd5-4aa9-4635-81a0-634abc50a309 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.320252 Sep 26 10:39:19.585520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 407/849] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:19 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:19.883866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:19.884482 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:19.890907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:19.891390 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:19.891839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:19.892521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:19.892974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:19.893400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:20.024652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:20.032442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d354552d-39ca-4e9c-bc37-054948254ec5 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1507 microversion: 2.1 time: 0.153103 Sep 26 10:39:20.033021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 443/850] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:19 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:20.610995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:20.612680 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:20.622592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:20.623412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:20.624385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:20.625241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:20.625842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:20.627909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:20.644753 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-fdee0e61-d8b6-4606-adec-59ff351162bf req-85a27079-8517-46a2-b2fd-5fc2b50f90f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "name": "network-vif-plugged", "status": "completed", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:20.654961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fdee0e61-d8b6-4606-adec-59ff351162bf req-85a27079-8517-46a2-b2fd-5fc2b50f90f1 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:20.655805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fdee0e61-d8b6-4606-adec-59ff351162bf req-85a27079-8517-46a2-b2fd-5fc2b50f90f1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:20.656410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-fdee0e61-d8b6-4606-adec-59ff351162bf req-85a27079-8517-46a2-b2fd-5fc2b50f90f1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:20.671023 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-fdee0e61-d8b6-4606-adec-59ff351162bf req-85a27079-8517-46a2-b2fd-5fc2b50f90f1 service nova] Creating event network-vif-plugged:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:39:20.676556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-fdee0e61-d8b6-4606-adec-59ff351162bf req-85a27079-8517-46a2-b2fd-5fc2b50f90f1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035416 Sep 26 10:39:20.677777 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 444/851] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:39:20.880598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:20.895073 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:20.896871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:20.899001 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-45b63d2c-b83a-4251-b949-a852aba65ebe tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.293057 Sep 26 10:39:20.899563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 408/852] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:20 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:21.926620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:21.927322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:21.934067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:21.934554 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:21.934992 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:21.935674 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:21.936131 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:21.936556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:22.066378 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:22.074469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:22.075919 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:22.077074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-49e0b32f-6d23-4592-9781-36483f3678d7 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.155283 Sep 26 10:39:22.077635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 445/853] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:21 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:23.104067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:23.104629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:23.111307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:23.111795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:23.112233 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:23.112934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:23.113423 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:23.113848 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:23.259764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:23.268213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:23.269750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:23.270936 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-aa205e61-5ad3-4441-b2f0-6ae3c795e333 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1731 microversion: 2.20 time: 0.171563 Sep 26 10:39:23.271499 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 409/854] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:23 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:24.032849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:24.033372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:24.040002 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:24.040488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:24.040960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:24.041650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:24.042146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:24.042584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:24.134634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lazy-loading 'services' on Instance uuid 86a0d990-0849-4bdf-b998-46ef72a35795 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:39:24.207882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-000855d3-b54c-42be-9244-aace042c4e2d tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments/7beda68b-ec7f-4e36-973d-e5e5087ecc02" status: 202 len: 0 microversion: 2.1 time: 0.178787 Sep 26 10:39:24.208422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 446/855] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:39:24 2022] DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments/7beda68b-ec7f-4e36-973d-e5e5087ecc02 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:39:24.217345 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:24.220170 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:24.226617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:24.227096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:24.227525 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:24.228211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:24.228655 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:24.229072 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:24.260552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1c6b5434-4b95-47b8-8042-f6f178e39fc1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047067 Sep 26 10:39:24.261201 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 410/856] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:39:24 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:24.297147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:24.297848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:24.304388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:24.305063 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:24.305499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:24.306790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:24.307276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:24.307697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:24.447389 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:24.455458 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:24.456917 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:24.458181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-abe6e9f1-6386-4b55-badc-80f567c9eb74 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1718 microversion: 2.20 time: 0.165204 Sep 26 10:39:24.458693 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 447/857] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:39:24 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:39:25.273625 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:25.275881 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:25.282897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:25.283398 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:25.283840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:25.284558 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:25.285034 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:25.285465 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:25.315530 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c313535f-0c43-43ab-bc1a-2c4ed8a21fec tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046433 Sep 26 10:39:25.316085 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 411/858] 10.222.0.49 () {58 vars in 1302 bytes} [Mon Sep 26 10:39:25 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 26 10:39:25.384544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:25.385428 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:25.391954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:25.392442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:25.392881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:25.393640 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:25.394119 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:25.394585 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:25.421796 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:39:25.424734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:25.499031 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0601f1b7-e4eb-4c07-a07a-b632ad79172a tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 204 len: 0 microversion: 2.1 time: 0.118830 Sep 26 10:39:25.499631 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 448/859] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:39:25 2022] DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:39:25.509498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:25.510331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:25.516416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:25.516961 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:25.517437 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:25.518210 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:25.518667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:25.519096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:25.652970 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:25.660676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0e15544f-c46a-475f-8e1f-324affaf2b85 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1681 microversion: 2.1 time: 0.156183 Sep 26 10:39:25.661242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 412/860] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:25 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:26.684665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:26.685548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:26.692049 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:26.692545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:26.692981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:26.693682 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:26.694165 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:26.694635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:26.845698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:26.854496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3b4a90d3-332b-47ca-a9d8-fd04de93822b tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1681 microversion: 2.1 time: 0.174628 Sep 26 10:39:26.855302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 449/861] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:26 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:27.881067 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:27.883888 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:27.893845 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:27.895093 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:27.895901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:27.898320 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:27.899956 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:27.900950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:27.999803 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b486a094550541729c19c8713a648243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49df2764440f4f2cb68d8d6284f07f47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:39:28.011617 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d7350ded-5af5-4870-baed-ba50fc9ba234 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 200 len: 1614 microversion: 2.1 time: 0.136545 Sep 26 10:39:28.012506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 413/862] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:27 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 1614 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:28.271673 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-667a42a7-5cc3-45fa-aa98-ec2641f96d06 req-beb2361f-dd87-4a40-a4db-ba22065135fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a0d990-0849-4bdf-b998-46ef72a35795", "name": "network-vif-deleted", "tag": "8381e42d-d3f3-48fb-ac13-b807cee6c194"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:28.286358 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-667a42a7-5cc3-45fa-aa98-ec2641f96d06 req-beb2361f-dd87-4a40-a4db-ba22065135fb service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:28.286776 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-667a42a7-5cc3-45fa-aa98-ec2641f96d06 req-beb2361f-dd87-4a40-a4db-ba22065135fb service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:28.287187 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-667a42a7-5cc3-45fa-aa98-ec2641f96d06 req-beb2361f-dd87-4a40-a4db-ba22065135fb service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:28.300184 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-667a42a7-5cc3-45fa-aa98-ec2641f96d06 req-beb2361f-dd87-4a40-a4db-ba22065135fb service nova] Creating event network-vif-deleted:8381e42d-d3f3-48fb-ac13-b807cee6c194 for instance 86a0d990-0849-4bdf-b998-46ef72a35795 on hv-cinder-84456 Sep 26 10:39:28.306267 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-667a42a7-5cc3-45fa-aa98-ec2641f96d06 req-beb2361f-dd87-4a40-a4db-ba22065135fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038350 Sep 26 10:39:28.307572 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 450/863] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:29.035620 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:29.036317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:29.043938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:29.044656 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:29.045321 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:29.046995 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:29.047659 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:29.048250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:29.067564 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 HTTP/1.1 Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:39:29.069598 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:29.071046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '86a0d990-0849-4bdf-b998-46ef72a35795'} Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:29.071897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:29.073195 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:29.074432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:29.074432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b55069af-7d0e-417d-b46e-65ac7f667243 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 404 len: 111 microversion: 2.1 time: 0.040473 Sep 26 10:39:29.074432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 414/864] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:29 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:29.081159 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8818c3f1-3ef3-479b-af1d-e4c9da3f3110 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '.version_select at 0x7fbadb19b040>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:29.102918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8818c3f1-3ef3-479b-af1d-e4c9da3f3110 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-387673985" status: 202 len: 0 microversion: 2.1 time: 0.025987 Sep 26 10:39:29.103504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 451/865] 10.222.0.49 () {58 vars in 1218 bytes} [Mon Sep 26 10:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-387673985 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:39:31.129079 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:31.129578 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:31.136582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:31.137061 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:31.137494 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:31.138218 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:31.138672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:31.139106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:31.152414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 HTTP/1.1 Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:39:31.153947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.155484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '86a0d990-0849-4bdf-b998-46ef72a35795'} Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:31.156508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.157944 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.159454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:31.159454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cfcbfe33-478f-4eab-8328-846fe2f1d21c tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 404 len: 111 microversion: 2.1 time: 0.030117 Sep 26 10:39:31.159454 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 415/866] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:39:31 2022] DELETE /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:31.164844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:31.165592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 86a0d990-0849-4bdf-b998-46ef72a35795] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:31.172591 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:31.173455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:31.173969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:31.174709 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:31.175170 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:31.175600 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:31.189892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 HTTP/1.1 Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:39:31.191605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.193053 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '86a0d990-0849-4bdf-b998-46ef72a35795'} Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:31.195478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. Sep 26 10:39:31.197575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:31.199044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 86a0d990-0849-4bdf-b998-46ef72a35795 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:31.199044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d4c3b086-cc94-40a1-a14a-f969867a7200 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795" status: 404 len: 111 microversion: 2.1 time: 0.033129 Sep 26 10:39:31.199044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 452/867] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:31 2022] GET /compute/v2.1/servers/86a0d990-0849-4bdf-b998-46ef72a35795 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:39:32.343351 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:32.343851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:32.350262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.350744 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.351176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.351859 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.352309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.352732 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.366330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 HTTP/1.1 Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:39:32.367786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.369365 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '32027e55-4845-402a-8c64-a0f4e072d638'} Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:32.370468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.371896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.373519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:32.373519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-29f89791-20a2-42a2-b456-664787bfeb74 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 404 len: 111 microversion: 2.1 time: 0.029661 Sep 26 10:39:32.373519 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 416/868] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:39:32 2022] DELETE /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:39:32.377367 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:32.378005 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 32027e55-4845-402a-8c64-a0f4e072d638] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:32.384833 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.385310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.385739 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.386442 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.386891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.387308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.400648 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 HTTP/1.1 Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:39:32.402150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.403701 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '32027e55-4845-402a-8c64-a0f4e072d638'} Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:32.404568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. Sep 26 10:39:32.405775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.406911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 32027e55-4845-402a-8c64-a0f4e072d638 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:32.406911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f472dce9-0db6-4f70-8688-40123fb731e1 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638" status: 404 len: 111 microversion: 2.1 time: 0.029968 Sep 26 10:39:32.406911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 453/869] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:32 2022] GET /compute/v2.1/servers/32027e55-4845-402a-8c64-a0f4e072d638 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:32.411697 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:32.412200 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:32.418133 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.418611 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.419047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.419726 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.420177 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.420596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.434973 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: DELETE /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d HTTP/1.1 Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:39:32.436472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.437977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '0c49866e-9fb8-4d0f-8e65-4cf8d565895d'} Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:32.438887 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.440323 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.441806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:32.441806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1001e6f6-5664-4194-bb00-168919d1beee tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 404 len: 111 microversion: 2.1 time: 0.029995 Sep 26 10:39:32.441806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 417/870] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:39:32 2022] DELETE /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:32.446593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:32.447206 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: 0c49866e-9fb8-4d0f-8e65-4cf8d565895d] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:32.452937 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.453416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.453847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.454551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:32.455001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:32.455421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:32.468215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d HTTP/1.1 Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:39:32.469671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.471242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '0c49866e-9fb8-4d0f-8e65-4cf8d565895d'} Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:32.472054 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. Sep 26 10:39:32.473504 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:32.474798 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance 0c49866e-9fb8-4d0f-8e65-4cf8d565895d could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:32.474798 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-02e697b9-a526-4bb4-a535-671364cda775 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d" status: 404 len: 111 microversion: 2.1 time: 0.028898 Sep 26 10:39:32.474798 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 454/871] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:32 2022] GET /compute/v2.1/servers/0c49866e-9fb8-4d0f-8e65-4cf8d565895d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 26 10:39:33.612609 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:33.613188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:33.619700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:33.620299 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:33.620822 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:33.621646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:33.622106 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:33.622955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:33.640841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 HTTP/1.1 Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:39:33.642432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.644021 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': 'bbcde70f-d1b6-40ce-8bcd-d17b1986f320'} Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:33.644814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.649992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.651604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:33.651604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-54bb0645-79a5-45b1-97a2-b269ddd5e657 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 404 len: 111 microversion: 2.1 time: 0.036107 Sep 26 10:39:33.651604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 418/872] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:39:33 2022] DELETE /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:33.655382 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:33.656071 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] [instance: bbcde70f-d1b6-40ce-8bcd-d17b1986f320] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:33.662253 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:33.662803 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:33.663344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:33.664111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:33.664629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:33.665124 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:33.678368 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] HTTP exception thrown: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Request method failure captured: Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 HTTP/1.1 Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMX_TVlxNja2XFB9-E3mG8yXfXS0oQA0KJXRXWp8Zlw7sLB4XqZpCVndHeoaqUlBuO9C9YhpTSFMDbtMCElhMnrhrC_GuKCmyqP2-Xky_P4nOUJ2Z_RSVmXsL5GWLc9XA6I6cNXhMSgAGV3N914bGMvFQ6v77N33Dc7YShLxRDdJwKms Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:39:33.679824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_49df2764440f4f2cb68d8d6284f07f47", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/49df2764440f4f2cb68d8d6284f07f47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 49df2764440f4f2cb68d8d6284f07f47 Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-364670835 Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: b486a094550541729c19c8713a648243 Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeNegativeTest-364670835-project Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.681387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': 'bbcde70f-d1b6-40ce-8bcd-d17b1986f320'} Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:39:33.685686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. Sep 26 10:39:33.687252 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:39:33.688544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] Returning 404 to user: Instance bbcde70f-d1b6-40ce-8bcd-d17b1986f320 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:39:33.688544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-bca09297-292b-4d92-86e9-bf2dc489ad39 tempest-AttachVolumeNegativeTest-364670835 tempest-AttachVolumeNegativeTest-364670835-project] 10.222.0.49 "GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320" status: 404 len: 111 microversion: 2.1 time: 0.030155 Sep 26 10:39:33.688544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 455/873] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:39:33 2022] GET /compute/v2.1/servers/bbcde70f-d1b6-40ce-8bcd-d17b1986f320 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:39:36.416089 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155b3fe5-6885-4a53-bb1d-64239c1523a1", "device": "/dev/sdb"}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:39:36.419003 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:39:36.426640 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:36.427346 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:36.427946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:36.429566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:39:36.430226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:39:36.430662 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:39:36.758950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-14d230b1-e207-4509-b391-2a6c9feb9000 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "POST /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346327 Sep 26 10:39:36.771723 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 419/874] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:39:36 2022] POST /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe/os-volume_attachments => generated 194 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:39.996670 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fafaa61c-6553-4c65-8b13-047f6c1afc10 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadeb06430>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:40.076328 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fafaa61c-6553-4c65-8b13-047f6c1afc10 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/3909ae1d-48f3-4527-b032-394aa0663d6e" status: 200 len: 351 microversion: 2.1 time: 0.083354 Sep 26 10:39:40.076895 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 456/875] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:39:39 2022] GET /compute/v2.1/os-volumes/3909ae1d-48f3-4527-b032-394aa0663d6e => generated 351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:41.428018 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a60ac71a-c34b-456b-a4fa-c5772eb49edc tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadafe4940>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:41.479988 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a60ac71a-c34b-456b-a4fa-c5772eb49edc tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5cc9d2cd-8541-48ec-9b4b-38f456aa6c1d" status: 200 len: 351 microversion: 2.1 time: 0.057443 Sep 26 10:39:41.480805 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 420/876] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:39:41 2022] GET /compute/v2.1/os-volumes/5cc9d2cd-8541-48ec-9b4b-38f456aa6c1d => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:42.842909 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-30db5457-8f18-4579-be08-dd9928bd5494 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadeac6280>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:42.896477 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-30db5457-8f18-4579-be08-dd9928bd5494 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/785a6f27-fd5f-4a24-a06e-6da8f056b7c2" status: 200 len: 351 microversion: 2.1 time: 0.058560 Sep 26 10:39:42.902077 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 457/877] 10.222.0.49 () {58 vars in 1245 bytes} [Mon Sep 26 10:39:42 2022] GET /compute/v2.1/os-volumes/785a6f27-fd5f-4a24-a06e-6da8f056b7c2 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:42.911271 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-eb41307a-ab4c-4136-a060-a1b4bc828e31 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadafc44c0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:42.996833 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-eb41307a-ab4c-4136-a060-a1b4bc828e31 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089721 Sep 26 10:39:42.997400 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 421/878] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Sep 26 10:39:42 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:43.014143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d8bffd11-b73b-44a8-846b-0e93f4296d3c tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadb19baf0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.152877 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d8bffd11-b73b-44a8-846b-0e93f4296d3c tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.142797 Sep 26 10:39:43.153454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 458/879] 10.222.0.49 () {58 vars in 1149 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:43.167706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7e9b833d-9a72-403d-b8ce-affb1ce1b934 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadafc4ca0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.309086 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7e9b833d-9a72-403d-b8ce-affb1ce1b934 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.144856 Sep 26 10:39:43.309335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 422/880] 10.222.0.49 () {58 vars in 1134 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:39:43.328105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a3151461-5812-4afc-bdf6-5fd68d2b3cb9 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadeb06670>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.414044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a3151461-5812-4afc-bdf6-5fd68d2b3cb9 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091897 Sep 26 10:39:43.414890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 459/881] 10.222.0.49 () {58 vars in 1167 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:43.430534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ea277b58-a962-4a06-855b-674e564dce6d tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadafc7040>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.522582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ea277b58-a962-4a06-855b-674e564dce6d tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.097239 Sep 26 10:39:43.523151 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 423/882] 10.222.0.49 () {58 vars in 1170 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:43.537153 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-5606ea9a-3f02-4f60-8b97-1df5e8679f00 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadeac60d0>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.622954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-5606ea9a-3f02-4f60-8b97-1df5e8679f00 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089564 Sep 26 10:39:43.623521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 460/883] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:39:43.636814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8f959b4a-efe8-4e0f-9b1b-583559867e62 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadafb3af0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.715498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8f959b4a-efe8-4e0f-9b1b-583559867e62 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082425 Sep 26 10:39:43.716066 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 424/884] 10.222.0.49 () {58 vars in 1188 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:39:43.726866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:43.727620 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:39:43.731685 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a388796d-092d-4ec6-9064-bd87cacdb685 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] Calling method '.version_select at 0x7fbadead7700>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:39:43.814911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a388796d-092d-4ec6-9064-bd87cacdb685 tempest-VolumesTestJSON-559398252 tempest-VolumesTestJSON-559398252-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.089282 Sep 26 10:39:43.815501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 461/885] 10.222.0.49 () {58 vars in 1155 bytes} [Mon Sep 26 10:39:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:03.679589 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=29 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:03.681377 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:03.686137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:03.686731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:03.695652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:03.696141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:03.697161 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:03.698049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:03.698668 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:03.699090 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:03.792215 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lazy-loading 'services' on Instance uuid 13f34933-c3cd-4b26-86c2-1fbee79f4fbe {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:40:03.882248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-046b90e2-6269-459f-8757-a05e4beafe5f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe/os-volume_attachments/155b3fe5-6885-4a53-bb1d-64239c1523a1" status: 202 len: 0 microversion: 2.1 time: 0.202687 Sep 26 10:40:03.882248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 425/886] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:40:03 2022] DELETE /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe/os-volume_attachments/155b3fe5-6885-4a53-bb1d-64239c1523a1 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:40:08.233608 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:08.234217 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:08.240055 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:08.240534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:08.240959 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:08.241642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:08.242119 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:08.242542 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:08.268203 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:40:08.358416 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8428dd4d-1d92-42a7-8bbe-beee10ba94b0 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "DELETE /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 204 len: 0 microversion: 2.1 time: 0.129496 Sep 26 10:40:08.359220 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 462/887] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:40:08 2022] DELETE /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 10:40:08.369694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:08.370430 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:08.377148 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:08.377875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:08.378339 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:08.379043 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:08.379500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:08.379924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:08.517953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:08.526084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-828e776d-b090-43fc-bcc0-13a81445cb91 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1513 microversion: 2.1 time: 0.162080 Sep 26 10:40:08.538047 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 426/888] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:08 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:09.551471 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:09.553021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:09.561156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:09.561751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:09.562448 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:09.563361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:09.564120 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:09.564678 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:09.730140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:09.738077 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3e98ab99-2d31-46ea-a492-7e232d794a75 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1513 microversion: 2.1 time: 0.191127 Sep 26 10:40:09.738659 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 463/889] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:09 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:10.519314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-5ab81451-6d6d-48c5-83f5-d10d571a6db0 req-70d456df-bd9e-45d6-9a3a-43f32d5bc897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13f34933-c3cd-4b26-86c2-1fbee79f4fbe", "name": "network-vif-deleted", "tag": "57839eaf-1949-4800-a7dc-981dea02ad7e"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:10.531182 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-5ab81451-6d6d-48c5-83f5-d10d571a6db0 req-70d456df-bd9e-45d6-9a3a-43f32d5bc897 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:10.531771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-5ab81451-6d6d-48c5-83f5-d10d571a6db0 req-70d456df-bd9e-45d6-9a3a-43f32d5bc897 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:10.532666 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-5ab81451-6d6d-48c5-83f5-d10d571a6db0 req-70d456df-bd9e-45d6-9a3a-43f32d5bc897 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:10.545561 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-5ab81451-6d6d-48c5-83f5-d10d571a6db0 req-70d456df-bd9e-45d6-9a3a-43f32d5bc897 service nova] Creating event network-vif-deleted:57839eaf-1949-4800-a7dc-981dea02ad7e for instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe on hv-cinder-84456 Sep 26 10:40:10.552792 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-5ab81451-6d6d-48c5-83f5-d10d571a6db0 req-70d456df-bd9e-45d6-9a3a-43f32d5bc897 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037190 Sep 26 10:40:10.553408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 427/890] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:40:10.764161 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:10.764795 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:10.771260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:10.771757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:10.772430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:10.773383 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:10.774006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:10.775395 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:10.815894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:10.816429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:10.817232 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:10.817698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lazy-loading 'fault' on Instance uuid 13f34933-c3cd-4b26-86c2-1fbee79f4fbe {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:40:10.880363 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:10.892151 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4a6ba647-e47e-4dde-b098-bbb66565b1ac tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 200 len: 1308 microversion: 2.1 time: 0.133777 Sep 26 10:40:10.892767 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 464/891] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:10 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:11.916387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:11.917084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 13f34933-c3cd-4b26-86c2-1fbee79f4fbe] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:11.923255 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:11.923736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:11.924192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:11.924875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:11.925346 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:11.925750 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:11.940614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] HTTP exception thrown: Instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe could not be found. Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Request method failure captured: Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe HTTP/1.1 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYFAQkzqKmtc3iby0B4QvAfMqBBU1w3nF3bMg6seEHiaxisYM_jO1MKbLIigq--W2YTsr1Ep_SZYCL2uDXFrZclAhMjqAgql0ndcoZR1N8AIlxkZVnSTw2-ZB3lBmla3Clq7FH7ckBRuiP5UU7j7XEdApbhXujl6jVswPzoceZ7fgk0 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 3e71ac778bf24f779d6d4c8c5de7e528 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesSnapshotTestJSON-722631633 Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:40:11.942241 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3e71ac778bf24f779d6d4c8c5de7e528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3e71ac778bf24f779d6d4c8c5de7e528", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e71ac778bf24f779d6d4c8c5de7e528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e71ac778bf24f779d6d4c8c5de7e528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesSnapshotTestJSON-722631633 Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 3e71ac778bf24f779d6d4c8c5de7e528 Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-722631633 Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesSnapshotTestJSON-722631633-project Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 57fa5ee68e6f48e982c312e6bb3a6ce6 Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesSnapshotTestJSON-722631633-project Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe could not be found. Sep 26 10:40:11.943909 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '13f34933-c3cd-4b26-86c2-1fbee79f4fbe'} Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe could not be found. Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:11.944800 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe could not be found. Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe could not be found. Sep 26 10:40:11.947226 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:11.948730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Returning 404 to user: Instance 13f34933-c3cd-4b26-86c2-1fbee79f4fbe could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:11.948730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-04851e8c-4b7c-439a-a817-3da638bf9d62 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe" status: 404 len: 111 microversion: 2.1 time: 0.031835 Sep 26 10:40:11.948730 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 428/892] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:11 2022] GET /compute/v2.1/servers/13f34933-c3cd-4b26-86c2-1fbee79f4fbe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:40:14.105130 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:14.107645 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:14.113454 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:14.113855 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:14.114317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:14.114998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:14.115443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:14.115861 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:14.148485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-15ba2b32-2c84-4bb8-965e-76fd6a8acabb tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047880 Sep 26 10:40:14.149531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 465/893] 10.222.0.49 () {60 vars in 1343 bytes} [Mon Sep 26 10:40:14 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:14.248865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:14.249358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:14.255570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:14.256051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:14.256490 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:14.257172 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:14.257623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:14.258063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:14.288468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:40:14.366878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-589521e7-3b96-44a1-816d-05732d6dd7a5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 204 len: 0 microversion: 2.20 time: 0.121806 Sep 26 10:40:14.367652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 429/894] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 10:40:14 2022] DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 10:40:14.376681 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:14.377285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:14.383387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:14.383878 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:14.384290 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:14.385015 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:14.385467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:14.385885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:14.512467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:14.520440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:14.521910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:14.523079 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d2dcaaf8-9a58-48a7-b2ba-a84ffca13a79 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.150269 Sep 26 10:40:14.523634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 466/895] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:14 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 26 10:40:15.549361 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:15.550113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:15.556422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:15.556924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:15.557357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:15.558055 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:15.558506 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:15.558924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:15.690783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:15.698712 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:15.700156 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:15.701291 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-40b0c29c-2dfa-4d6b-a64d-7c306b7829db tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.156267 Sep 26 10:40:15.701844 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 430/896] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:15 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:40:16.726808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:16.727430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:16.734286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:16.734757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:16.735224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:16.735918 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:16.736377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:16.736805 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:16.869666 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:16.877791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:16.879293 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:16.880455 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-060f80b9-4964-4bf0-bdd3-52909672fe76 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.157562 Sep 26 10:40:16.881014 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 467/897] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:16 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:40:17.928420 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:17.928420 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:17.936788 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:17.937298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:17.937734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:17.938482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:17.939142 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:17.939996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:18.027472 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1660836398", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:18.082725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] validate_networks() for None {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:40:18.091778 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:18.100018 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:18.101468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:18.102650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f6a74b07-1aa0-4848-bbee-513701702b4a tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1724 microversion: 2.20 time: 0.192313 Sep 26 10:40:18.103212 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 431/898] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:17 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:40:18.489942 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:40:18.490386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:40:18.491032 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:40:18.491890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:40:18.491890 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:40:18.507990 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:18.508552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:18.509060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:18.509882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:18.510503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:18.511004 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:18.528923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Getting quotas for project 4c206e1031144f509a8957ad347ac345. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:40:18.533042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Getting quotas for user 1f631f56726c4cab8bd7d61076208b18 and project 4c206e1031144f509a8957ad347ac345. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:40:18.544757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:40:18.547070 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:40:18.591148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-74664093-2efb-4573-9240-72bcf996e425 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567891 Sep 26 10:40:18.592070 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 468/899] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:40:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 26 10:40:18.603126 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-59a47b9f-5862-4518-add5-1ac31398acda tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:18.604291 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-59a47b9f-5862-4518-add5-1ac31398acda tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:18.705415 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-59a47b9f-5862-4518-add5-1ac31398acda tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:18.715474 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-59a47b9f-5862-4518-add5-1ac31398acda tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1215 microversion: 2.1 time: 0.116103 Sep 26 10:40:18.730050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 432/900] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:18 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1215 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:19.128977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:19.129643 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:19.135934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:19.136411 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:19.136844 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:19.137545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:19.138215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:19.138635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:19.219348 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:19.227405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:19.229300 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:19.230555 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e2fc7b7d-2a04-4a0f-b6a5-b847b54e9b32 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1656 microversion: 2.20 time: 0.106072 Sep 26 10:40:19.231331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 469/901] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:19 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1656 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:40:19.286245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-bc262e88-b42f-43c4-a605-231a2c25385a req-5195c574-e7f5-4f5d-a7e8-4b29cefb46a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e17bf82-8d15-4e83-a313-89a8126ff033", "name": "network-vif-deleted", "tag": "e97964be-97f3-4350-a687-7c69042847bd"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:19.297125 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-bc262e88-b42f-43c4-a605-231a2c25385a req-5195c574-e7f5-4f5d-a7e8-4b29cefb46a6 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:19.297698 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-bc262e88-b42f-43c4-a605-231a2c25385a req-5195c574-e7f5-4f5d-a7e8-4b29cefb46a6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:19.298162 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-bc262e88-b42f-43c4-a605-231a2c25385a req-5195c574-e7f5-4f5d-a7e8-4b29cefb46a6 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:19.309131 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-bc262e88-b42f-43c4-a605-231a2c25385a req-5195c574-e7f5-4f5d-a7e8-4b29cefb46a6 service nova] Creating event network-vif-deleted:e97964be-97f3-4350-a687-7c69042847bd for instance 0e17bf82-8d15-4e83-a313-89a8126ff033 on hv-cinder-84456 Sep 26 10:40:19.314578 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-bc262e88-b42f-43c4-a605-231a2c25385a req-5195c574-e7f5-4f5d-a7e8-4b29cefb46a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Sep 26 10:40:19.315440 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 433/902] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:40:19.740031 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:19.740902 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:19.747848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:19.748333 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:19.748770 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:19.749474 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:19.749929 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:19.750380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:19.812074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:19.819621 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-11c944ff-5be5-47d9-9d2e-5be0bec857e7 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1219 microversion: 2.1 time: 0.083499 Sep 26 10:40:19.820443 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 470/903] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:19 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:20.257105 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:20.257834 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:20.264578 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:20.265173 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:20.265618 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:20.266418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:20.266879 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:20.267431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:20.330957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:20.339513 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:20.340968 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:20.342181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0f91c0ab-a36f-4911-80df-3ecbdf0708ea tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1656 microversion: 2.20 time: 0.089464 Sep 26 10:40:20.342762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 434/904] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:20 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:40:20.842598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:20.843209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:20.849539 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:20.850016 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:20.850477 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:20.851160 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:20.851612 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:20.852035 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:20.913317 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:20.920759 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b6f08b38-cd38-4cf0-a8b3-c22d34adb032 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1219 microversion: 2.1 time: 0.082562 Sep 26 10:40:20.921322 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 471/905] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:20 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:21.368600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:21.369248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:21.375799 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:21.376284 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:21.376724 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:21.377414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:21.377874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:21.378342 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:21.440945 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:21.449059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:21.450539 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8c8ebfdad6ab437eb7dda111fee84205', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cccae871b94a9db82b5017c2c497c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:21.451675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-48cb0125-50c3-46bd-ac91-014265cefc1b tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 200 len: 1656 microversion: 2.20 time: 0.087136 Sep 26 10:40:21.452231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 435/906] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:21 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 26 10:40:21.887532 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1937512642", "imageRef": "d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c", "flavorRef": "452", "networks": [{"uuid": "4100a641-533c-49ba-9608-c77b1227d5d8"}]}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:21.939886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] validate_networks() for [('4100a641-533c-49ba-9608-c77b1227d5d8', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:40:21.944208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:21.944819 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:21.950756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:21.951236 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:21.951661 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:21.952349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:21.952795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:21.953213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:22.298164 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:22.307874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c8984bcb-3c82-4dce-a7be-4d9bca0dde35 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1211 microversion: 2.1 time: 0.367685 Sep 26 10:40:22.308763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 436/907] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:21 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1211 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:40:22.478168 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:22.478847 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:22.486184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:22.487317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:22.488056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:22.488769 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:22.489230 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:22.489689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:22.504590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] HTTP exception thrown: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Request method failure captured: Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 HTTP/1.1 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYArjrx41rH6_oHblj6RIzI-OHxPlwHNIDY89If8YuLYnBoOj5dbMYboxjNYmwmHngAHAmfbqLy2kEE-Fgf7iFj2d-lhlWYgjybLwjxY6Fd7LYN3k4ty9Ik9woQxVbA9w7hGNq5AcaVQvS8lZd8E4WL3NJV0F2zq_tLkoAu-cX7Lvto Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:40:22.506360 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38cccae871b94a9db82b5017c2c497c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 8c8ebfdad6ab437eb7dda111fee84205 Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:22.507922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '0e17bf82-8d15-4e83-a313-89a8126ff033'} Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:22.508700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:22.510789 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:22.512425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Returning 404 to user: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:22.512425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-927cb81d-fef2-4552-a8d3-cdd2b28c022c tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 404 len: 111 microversion: 2.20 time: 0.034929 Sep 26 10:40:22.512425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 437/908] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:22 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 10:40:22.517120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d2d75cbe-fe7a-4f09-955f-ac1d512110f5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '.version_select at 0x7fbadafc7ca0>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:22.537376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d2d75cbe-fe7a-4f09-955f-ac1d512110f5 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-943532567" status: 204 len: 0 microversion: 2.20 time: 0.023790 Sep 26 10:40:22.538633 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 438/909] 10.222.0.49 () {60 vars in 1259 bytes} [Mon Sep 26 10:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-943532567 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 26 10:40:22.626103 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:40:22.626551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:40:22.627018 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:40:22.627611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:40:22.628017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:40:22.637602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:22.638567 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:22.639686 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:22.640754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:22.641847 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:22.642606 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:22.663384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Getting quotas for project 3e71ac778bf24f779d6d4c8c5de7e528. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:40:22.667730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Getting quotas for user 57fa5ee68e6f48e982c312e6bb3a6ce6 and project 3e71ac778bf24f779d6d4c8c5de7e528. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:40:22.680432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:40:22.685783 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d64b0bd3-01e8-43ed-ba65-5ceeb64dfe8c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:40:22.750185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-aebed3df-6b50-41be-a71c-cc518ef9fd61 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.866418 Sep 26 10:40:22.750841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 472/910] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:40:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:40:22.762716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bdf6f08a-dbb9-44e8-8a76-969852ab91d9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:22.763804 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bdf6f08a-dbb9-44e8-8a76-969852ab91d9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:22.843006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-bdf6f08a-dbb9-44e8-8a76-969852ab91d9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:22.859094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bdf6f08a-dbb9-44e8-8a76-969852ab91d9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1219 microversion: 2.1 time: 0.100630 Sep 26 10:40:22.862184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 439/911] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:22 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:23.331632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:23.332987 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:23.341226 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:23.341757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:23.342391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:23.343309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:23.343780 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:23.344201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:23.463869 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:23.477954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-08701a05-cebd-45da-a3fc-55712b2b32fc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1273 microversion: 2.1 time: 0.150181 Sep 26 10:40:23.495142 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 473/912] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:23 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:23.884573 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:23.886547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:23.894830 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:23.895542 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:23.896044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:23.896902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:23.897680 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:23.908671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:23.997670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:24.010590 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-62020b80-90b5-4b09-9bca-e9faced90668 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1271 microversion: 2.1 time: 0.130771 Sep 26 10:40:24.011871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 440/913] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:23 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:24.508432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:24.509603 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:24.520397 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:24.521100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:24.521843 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:24.522694 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:24.523395 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:24.523923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:24.796026 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:24.804970 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-772dc734-8e8c-42fd-a6d1-453b63ee91f0 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.301532 Sep 26 10:40:24.805474 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 474/914] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:24 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:25.037835 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:25.038900 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:25.040599 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:25.041146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:25.045707 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.046249 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.046689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.047394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.047856 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.048282 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.048590 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.049094 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.049535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.050286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.050975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.051638 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.071258 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] HTTP exception thrown: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Request method failure captured: Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 HTTP/1.1 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYArjrx41rH6_oHblj6RIzI-OHxPlwHNIDY89If8YuLYnBoOj5dbMYboxjNYmwmHngAHAmfbqLy2kEE-Fgf7iFj2d-lhlWYgjybLwjxY6Fd7LYN3k4ty9Ik9woQxVbA9w7hGNq5AcaVQvS8lZd8E4WL3NJV0F2zq_tLkoAu-cX7Lvto Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:40:25.073668 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38cccae871b94a9db82b5017c2c497c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 8c8ebfdad6ab437eb7dda111fee84205 Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.075211 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '0e17bf82-8d15-4e83-a313-89a8126ff033'} Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:25.075973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.077191 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.078487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Returning 404 to user: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:25.078487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-36eba758-2ae5-4773-be03-5985b62d4528 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 404 len: 111 microversion: 2.20 time: 0.039150 Sep 26 10:40:25.078487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 475/915] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 10:40:25 2022] DELETE /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 10:40:25.086965 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:25.087576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 0e17bf82-8d15-4e83-a313-89a8126ff033] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:25.094247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.094741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.095180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.095880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.096338 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.096766 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.145149 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:25.156805 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b7924677-c8a8-43df-ba97-a95b5c28796e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1277 microversion: 2.1 time: 0.125462 Sep 26 10:40:25.157409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 441/916] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:25 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:25.258941 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] HTTP exception thrown: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Request method failure captured: Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 HTTP/1.1 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYArjrx41rH6_oHblj6RIzI-OHxPlwHNIDY89If8YuLYnBoOj5dbMYboxjNYmwmHngAHAmfbqLy2kEE-Fgf7iFj2d-lhlWYgjybLwjxY6Fd7LYN3k4ty9Ik9woQxVbA9w7hGNq5AcaVQvS8lZd8E4WL3NJV0F2zq_tLkoAu-cX7Lvto Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:40:25.261028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38cccae871b94a9db82b5017c2c497c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 8c8ebfdad6ab437eb7dda111fee84205 Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.262755 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '0e17bf82-8d15-4e83-a313-89a8126ff033'} Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:25.263683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. Sep 26 10:40:25.265140 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:25.267740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Returning 404 to user: Instance 0e17bf82-8d15-4e83-a313-89a8126ff033 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:25.267740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-46e764d3-977c-4308-974a-ee8f36921f84 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033" status: 404 len: 111 microversion: 2.20 time: 0.179194 Sep 26 10:40:25.267740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 476/917] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:25 2022] GET /compute/v2.1/servers/0e17bf82-8d15-4e83-a313-89a8126ff033 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 10:40:25.508063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-f0261e78-6f4a-4724-b60b-3a73c45a8c6c req-bc6e1a68-f264-48a0-8b94-c427d192c3bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a415dda-e3b5-4530-9fa7-bf6c9ab75932", "tag": "2b942dc5-daa5-4310-8b0c-5356e30381ec"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:25.521167 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-f0261e78-6f4a-4724-b60b-3a73c45a8c6c req-bc6e1a68-f264-48a0-8b94-c427d192c3bd service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.522057 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-f0261e78-6f4a-4724-b60b-3a73c45a8c6c req-bc6e1a68-f264-48a0-8b94-c427d192c3bd service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.522856 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-f0261e78-6f4a-4724-b60b-3a73c45a8c6c req-bc6e1a68-f264-48a0-8b94-c427d192c3bd service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.536068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-f0261e78-6f4a-4724-b60b-3a73c45a8c6c req-bc6e1a68-f264-48a0-8b94-c427d192c3bd service nova] Creating event network-changed:2b942dc5-daa5-4310-8b0c-5356e30381ec for instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 on hv-cinder-84456 Sep 26 10:40:25.541929 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-f0261e78-6f4a-4724-b60b-3a73c45a8c6c req-bc6e1a68-f264-48a0-8b94-c427d192c3bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040124 Sep 26 10:40:25.542863 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 442/918] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:40:25.828880 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:25.830265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:25.837468 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.838129 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.838644 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:25.839420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:25.839883 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:25.840309 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.181312 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:26.182468 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:26.188947 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:26.189645 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:26.189771 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:26.190113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.190806 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:26.191261 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:26.191686 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.199388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-987635d1-2cfb-4ba2-907f-f842c77658af tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.374559 Sep 26 10:40:26.199947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 477/919] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:25 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:26.408235 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:26.408748 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:26.415637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:26.416790 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:26.417261 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.417968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:26.418447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:26.418879 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.434250 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] HTTP exception thrown: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Request method failure captured: Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada HTTP/1.1 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYArjrx41rH6_oHblj6RIzI-OHxPlwHNIDY89If8YuLYnBoOj5dbMYboxjNYmwmHngAHAmfbqLy2kEE-Fgf7iFj2d-lhlWYgjybLwjxY6Fd7LYN3k4ty9Ik9woQxVbA9w7hGNq5AcaVQvS8lZd8E4WL3NJV0F2zq_tLkoAu-cX7Lvto Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:40:26.435761 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38cccae871b94a9db82b5017c2c497c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 8c8ebfdad6ab437eb7dda111fee84205 Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.437404 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '05d17109-d4ce-4939-89c1-efb485f67ada'} Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:26.438270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.440115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.442265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Returning 404 to user: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:26.442265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-2394c7ff-e677-4970-ad90-7cb3c1358bee tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 404 len: 111 microversion: 2.20 time: 0.033111 Sep 26 10:40:26.442265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 478/920] 10.222.0.49 () {60 vars in 1280 bytes} [Mon Sep 26 10:40:26 2022] DELETE /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 10:40:26.446076 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:26.446690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] [instance: 05d17109-d4ce-4939-89c1-efb485f67ada] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:26.452747 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:26.453219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:26.453652 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.454384 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:26.454836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:26.455261 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:26.469010 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] HTTP exception thrown: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Request method failure captured: Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada HTTP/1.1 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYArjrx41rH6_oHblj6RIzI-OHxPlwHNIDY89If8YuLYnBoOj5dbMYboxjNYmwmHngAHAmfbqLy2kEE-Fgf7iFj2d-lhlWYgjybLwjxY6Fd7LYN3k4ty9Ik9woQxVbA9w7hGNq5AcaVQvS8lZd8E4WL3NJV0F2zq_tLkoAu-cX7Lvto Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Openstack-Nova-Api-Version: 2.20 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:40:26.470560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_38cccae871b94a9db82b5017c2c497c1", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/38cccae871b94a9db82b5017c2c497c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 38cccae871b94a9db82b5017c2c497c1 Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1499368495 Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 8c8ebfdad6ab437eb7dda111fee84205 Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1499368495-project Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.472210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '05d17109-d4ce-4939-89c1-efb485f67ada'} Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:26.472975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. Sep 26 10:40:26.474451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:40:26.475552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] Returning 404 to user: Instance 05d17109-d4ce-4939-89c1-efb485f67ada could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:26.475552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0602704b-ca57-4732-a1ae-42e7ce203914 tempest-AttachVolumeShelveTestJSON-1499368495 tempest-AttachVolumeShelveTestJSON-1499368495-project] 10.222.0.49 "GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada" status: 404 len: 111 microversion: 2.20 time: 0.029608 Sep 26 10:40:26.475552 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 479/921] 10.222.0.49 () {60 vars in 1277 bytes} [Mon Sep 26 10:40:26 2022] GET /compute/v2.1/servers/05d17109-d4ce-4939-89c1-efb485f67ada => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 26 10:40:26.532088 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:26.540012 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fcaa497a-8a28-4a30-9746-00f9026f47e4 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.363576 Sep 26 10:40:26.540575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 443/922] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:26 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:40:27.221876 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:27.222540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:27.229326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:27.229815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:27.230275 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:27.230962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:27.231413 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:27.231836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:27.251498 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:27.402547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:27.413961 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d87bf353-2c74-41ce-8b41-1b6725025a8a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.195799 Sep 26 10:40:27.415150 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 480/923] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:27 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:27.563383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:27.564688 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:27.573817 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:27.574568 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:27.575307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:27.576252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:27.577099 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:27.581584 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:27.585641 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-3a22785b-704e-477e-813d-bb5b44e986b2 req-ec95fb12-2e83-4c86-b2c7-6873ce7b1f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da5ce05-abb7-42fa-8dba-d17dc3abd236", "tag": "7e50437a-eb56-403a-84f2-ba7d8567bc77"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:27.598192 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-3a22785b-704e-477e-813d-bb5b44e986b2 req-ec95fb12-2e83-4c86-b2c7-6873ce7b1f7b service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:27.598950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-3a22785b-704e-477e-813d-bb5b44e986b2 req-ec95fb12-2e83-4c86-b2c7-6873ce7b1f7b service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:27.599549 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-3a22785b-704e-477e-813d-bb5b44e986b2 req-ec95fb12-2e83-4c86-b2c7-6873ce7b1f7b service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:27.626742 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-3a22785b-704e-477e-813d-bb5b44e986b2 req-ec95fb12-2e83-4c86-b2c7-6873ce7b1f7b service nova] Creating event network-changed:7e50437a-eb56-403a-84f2-ba7d8567bc77 for instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 on hv-cinder-84456 Sep 26 10:40:27.636984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-3a22785b-704e-477e-813d-bb5b44e986b2 req-ec95fb12-2e83-4c86-b2c7-6873ce7b1f7b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055596 Sep 26 10:40:27.637933 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 481/924] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:40:27.897420 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:27.906725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b07c70b8-1812-40fc-83f5-fa9b40999fd8 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.347588 Sep 26 10:40:27.922189 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 444/925] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:27 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:28.438827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:28.440069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:28.446469 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:28.447200 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:28.448597 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:28.449301 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:28.449923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:28.450531 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:28.636381 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:28.645854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b255e121-de32-4151-ab09-27a2f9843067 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.212155 Sep 26 10:40:28.646457 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 482/926] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:28 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:28.932451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:28.933273 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:28.940043 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:28.940902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:28.941348 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:28.942240 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:28.942836 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:28.943426 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:28.969313 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:29.108996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:29.118940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1f2960ed-bc28-4b87-b307-d80d68221ee2 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.192243 Sep 26 10:40:29.134496 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 445/927] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:28 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:29.677345 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:29.677957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:29.686598 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:29.687960 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:29.690550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:29.691448 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:29.694222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:29.695098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:29.954331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:29.965924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b55c5c1e-7434-44bf-8668-230c7c6e82ec tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.298152 Sep 26 10:40:29.966903 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 483/928] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:29 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:30.143132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:30.144375 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:30.151335 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:30.151744 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:30.152180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:30.154677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:30.155489 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:30.156116 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:30.358851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:30.367687 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9bfa3b8a-17ba-4092-bc01-efe0e66a704c tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.228578 Sep 26 10:40:30.368722 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 446/929] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:30 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:30.990945 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:30.991717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:30.997996 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:30.998674 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:30.999187 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:30.999973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:31.000579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:31.001083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:31.144858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:31.154643 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8bd75178-3b08-4853-85c0-8389e2959960 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.169579 Sep 26 10:40:31.162388 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 484/930] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:30 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:31.396251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:31.396871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:31.403416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:31.403916 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:31.404356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:31.405054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:31.405511 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:31.405937 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:31.543191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:31.550997 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-739fb063-360d-4580-9605-12c8c9aac09e tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.158561 Sep 26 10:40:31.551646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 447/931] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:31 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:31.968298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-1ea78264-0d94-4aac-a3de-ec57fcf8eb0c req-35c2e943-9c49-4204-8566-f10ce7e28ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a415dda-e3b5-4530-9fa7-bf6c9ab75932", "name": "network-vif-plugged", "status": "completed", "tag": "2b942dc5-daa5-4310-8b0c-5356e30381ec"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:31.978133 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1ea78264-0d94-4aac-a3de-ec57fcf8eb0c req-35c2e943-9c49-4204-8566-f10ce7e28ab7 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:31.979259 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1ea78264-0d94-4aac-a3de-ec57fcf8eb0c req-35c2e943-9c49-4204-8566-f10ce7e28ab7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:31.979592 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1ea78264-0d94-4aac-a3de-ec57fcf8eb0c req-35c2e943-9c49-4204-8566-f10ce7e28ab7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:31.993013 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-1ea78264-0d94-4aac-a3de-ec57fcf8eb0c req-35c2e943-9c49-4204-8566-f10ce7e28ab7 service nova] Creating event network-vif-plugged:2b942dc5-daa5-4310-8b0c-5356e30381ec for instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 on hv-cinder-84456 Sep 26 10:40:31.999591 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-1ea78264-0d94-4aac-a3de-ec57fcf8eb0c req-35c2e943-9c49-4204-8566-f10ce7e28ab7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035290 Sep 26 10:40:32.000181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 485/932] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:40:32.178200 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:32.179520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:32.185670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:32.186207 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:32.186875 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:32.187588 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:32.188049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:32.188477 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:32.344516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:32.353650 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-fb76c639-6941-4ae5-9570-3cf018d14e0f tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.180706 Sep 26 10:40:32.354563 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 448/933] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:32 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:32.576641 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:32.577415 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:32.584118 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:32.584930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:32.591934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:32.591934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:32.591934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:32.591934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:32.653440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=4 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:32.677766 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=12 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:32.728050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:32.736575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c7d44639-e957-46a6-960e-23fddfac3b57 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.164389 Sep 26 10:40:32.737297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 486/934] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:32 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:33.376428 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:33.377037 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:33.379307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=4 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:33.384689 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:33.385764 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:33.386401 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:33.387193 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:33.387770 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:33.388263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:33.527671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:33.535387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-22a73462-1bf9-4d18-87b1-07246628c9ab tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1315 microversion: 2.1 time: 0.162669 Sep 26 10:40:33.536318 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 449/935] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:33 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:33.762201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:33.762989 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:33.770105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:33.770582 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:33.771126 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:33.772240 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:33.772815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:33.773515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:33.933297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:33.941586 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-96add86c-d7b7-4e39-b784-fe871d395e48 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.184676 Sep 26 10:40:33.942186 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 487/936] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:33 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:34.032349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-c38ea9a2-e57e-4468-9d8e-4a77f77dcc90 req-0f26955b-b847-470e-9a03-e332ac0ed25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da5ce05-abb7-42fa-8dba-d17dc3abd236", "name": "network-vif-plugged", "status": "completed", "tag": "7e50437a-eb56-403a-84f2-ba7d8567bc77"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:34.037534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:34.043978 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c38ea9a2-e57e-4468-9d8e-4a77f77dcc90 req-0f26955b-b847-470e-9a03-e332ac0ed25d service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.044466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c38ea9a2-e57e-4468-9d8e-4a77f77dcc90 req-0f26955b-b847-470e-9a03-e332ac0ed25d service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.045149 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-c38ea9a2-e57e-4468-9d8e-4a77f77dcc90 req-0f26955b-b847-470e-9a03-e332ac0ed25d service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:34.057458 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-c38ea9a2-e57e-4468-9d8e-4a77f77dcc90 req-0f26955b-b847-470e-9a03-e332ac0ed25d service nova] Creating event network-vif-plugged:7e50437a-eb56-403a-84f2-ba7d8567bc77 for instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 on hv-cinder-84456 Sep 26 10:40:34.063044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-c38ea9a2-e57e-4468-9d8e-4a77f77dcc90 req-0f26955b-b847-470e-9a03-e332ac0ed25d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034994 Sep 26 10:40:34.064009 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 450/937] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:40:34.561494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:34.562163 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:34.568584 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.569196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.569697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:34.570542 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.571067 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.571562 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:34.898583 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:34.906588 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ecc9e047-1d84-4f52-b60c-06c58917d03d tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1464 microversion: 2.1 time: 0.349591 Sep 26 10:40:34.907236 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 488/938] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:34 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:34.964696 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:34.964967 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:34.965820 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:34.966385 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:34.973692 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.974566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.975099 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:34.975918 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.976438 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.976933 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:34.991427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.991923 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.992370 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:34.993081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:34.993560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:34.993974 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:35.017955 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:40:35.121355 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0f5f89be-85ee-42b6-9ee4-79f9ca406848 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 204 len: 0 microversion: 2.1 time: 0.162181 Sep 26 10:40:35.121943 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 451/939] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:40:34 2022] DELETE /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:40:35.131249 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:35.132179 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:35.139364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:35.140042 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:35.140894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:35.141802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:35.143124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:35.143754 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:35.170966 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:35.192027 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d52eeb0f-f2c9-4a3d-a4bf-80f05e7691be tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.230908 Sep 26 10:40:35.192832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 489/940] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:34 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:35.490950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:35.498634 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c429273c-a3c0-4829-8954-86b76e5d4ccc tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1470 microversion: 2.1 time: 0.371409 Sep 26 10:40:35.499204 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 452/941] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:35 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:36.223481 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:36.224102 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:36.231440 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:36.231921 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:36.232732 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:36.233424 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:36.233873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:36.234325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:36.382830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:36.391042 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-313f7368-f6d2-44bc-8246-b8c8a14bdd6d tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1319 microversion: 2.1 time: 0.172429 Sep 26 10:40:36.391534 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 490/942] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:36 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:36.522798 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:36.523413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:36.530221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:36.530700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:36.531132 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:36.531821 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:36.532272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:36.532696 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:36.671084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:36.679113 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-82f3b54e-d841-4e56-a681-6a45edfe058a tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1470 microversion: 2.1 time: 0.160042 Sep 26 10:40:36.679786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 453/943] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:36 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:37.289313 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-3c67c7b9-a601-4077-b85f-66113911a5fc req-0c26fcf5-ed80-4c5c-bb78-1f8cfc527ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a415dda-e3b5-4530-9fa7-bf6c9ab75932", "name": "network-vif-deleted", "tag": "2b942dc5-daa5-4310-8b0c-5356e30381ec"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:37.316310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-3c67c7b9-a601-4077-b85f-66113911a5fc req-0c26fcf5-ed80-4c5c-bb78-1f8cfc527ff1 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.316942 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-3c67c7b9-a601-4077-b85f-66113911a5fc req-0c26fcf5-ed80-4c5c-bb78-1f8cfc527ff1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.317545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-3c67c7b9-a601-4077-b85f-66113911a5fc req-0c26fcf5-ed80-4c5c-bb78-1f8cfc527ff1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.331935 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-3c67c7b9-a601-4077-b85f-66113911a5fc req-0c26fcf5-ed80-4c5c-bb78-1f8cfc527ff1 service nova] Creating event network-vif-deleted:2b942dc5-daa5-4310-8b0c-5356e30381ec for instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 on hv-cinder-84456 Sep 26 10:40:37.337495 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-3c67c7b9-a601-4077-b85f-66113911a5fc req-0c26fcf5-ed80-4c5c-bb78-1f8cfc527ff1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051809 Sep 26 10:40:37.339125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 491/944] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:40:37.415245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:37.415923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:37.422831 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.423287 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.423794 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.424636 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.425254 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.425674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.569566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:37.577700 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-49dcd60e-871b-445f-8ab9-8aa123bbe535 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1508 microversion: 2.1 time: 0.167095 Sep 26 10:40:37.578373 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 454/945] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:37 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:40:37.600815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28fc01c9-0982-4e94-95ef-fc893027071e", "device": "/dev/sdb"}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:40:37.603787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:37.610182 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.610669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.611126 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.611938 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.612274 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.612697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.703765 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:37.704307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:37.710266 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.710759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.711197 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.711895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.712352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.712783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.748248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:37.748816 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:37.749180 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:37.749632 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lazy-loading 'fault' on Instance uuid 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:40:37.795480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f631f56726c4cab8bd7d61076208b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c206e1031144f509a8957ad347ac345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:37.805063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-f9706544-7abd-42ec-8030-76c887602306 tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 200 len: 1305 microversion: 2.1 time: 0.105115 Sep 26 10:40:37.805993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 455/946] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:37 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:40:37.905589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-343eea5f-3849-4adb-a83a-34d5e5440782 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "POST /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309011 Sep 26 10:40:37.906445 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 492/947] 10.222.0.49 () {60 vars in 1323 bytes} [Mon Sep 26 10:40:37 2022] POST /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:40:38.830866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:38.831544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] [instance: 3a415dda-e3b5-4530-9fa7-bf6c9ab75932] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:38.837870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:38.838455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:38.839383 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:38.840077 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:38.840535 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:38.840972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:38.856963 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] HTTP exception thrown: Instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 could not be found. Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Request method failure captured: Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 HTTP/1.1 Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYGLSsvyi5Dqc19FwaHKRn7QqVU1arD91fqbgAkyf0h9MZM130kVnZ5MJeWxx8xF1ovhxAjAfxRZJQp4u5TQN_dsdKgOJpkv1LLb9UYce23Ja3qjWBAwK_bQNo0SrlgLc3c5qWV_F1bC46WeVhOsSVlktJWVYSOQ11dwC8G2ct3RP1s Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 4c206e1031144f509a8957ad347ac345 Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-VolumesNegativeTest-1078162991 Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:40:38.858913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/4c206e1031144f509a8957ad347ac345"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_4c206e1031144f509a8957ad347ac345", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c206e1031144f509a8957ad347ac345"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/4c206e1031144f509a8957ad347ac345"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-VolumesNegativeTest-1078162991 Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 4c206e1031144f509a8957ad347ac345 Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-VolumesNegativeTest-1078162991 Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-VolumesNegativeTest-1078162991-project Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 1f631f56726c4cab8bd7d61076208b18 Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-VolumesNegativeTest-1078162991-project Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 could not be found. Sep 26 10:40:38.860533 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '3a415dda-e3b5-4530-9fa7-bf6c9ab75932'} Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 could not be found. Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:40:38.861436 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 could not be found. Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 could not be found. Sep 26 10:40:38.863331 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:40:38.864917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] Returning 404 to user: Instance 3a415dda-e3b5-4530-9fa7-bf6c9ab75932 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:40:38.864917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-97511efd-ef43-4183-a974-264687541fed tempest-VolumesNegativeTest-1078162991 tempest-VolumesNegativeTest-1078162991-project] 10.222.0.49 "GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932" status: 404 len: 111 microversion: 2.1 time: 0.033458 Sep 26 10:40:38.864917 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 456/948] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:38 2022] GET /compute/v2.1/servers/3a415dda-e3b5-4530-9fa7-bf6c9ab75932 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:40:57.404034 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:57.404865 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:57.409804 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:57.410423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:57.420619 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:57.421144 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:57.421573 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:57.422329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:57.422788 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:57.423217 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:57.505132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lazy-loading 'services' on Instance uuid 4da5ce05-abb7-42fa-8dba-d17dc3abd236 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:40:57.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e9daa711-02a0-40bd-a690-cdcfc96302a6 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236/os-volume_attachments/28fc01c9-0982-4e94-95ef-fc893027071e" status: 202 len: 0 microversion: 2.1 time: 0.177430 Sep 26 10:40:57.576962 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 493/949] 10.222.0.49 () {58 vars in 1416 bytes} [Mon Sep 26 10:40:57 2022] DELETE /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236/os-volume_attachments/28fc01c9-0982-4e94-95ef-fc893027071e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:40:58.705345 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:58.706678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:58.708741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:58.709505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:40:58.715192 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:58.715612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:58.716050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:58.716747 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:58.717199 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:58.717768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:58.748412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:40:58.828048 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bff2535a-9a25-4efa-9e22-5a230a4c1dd3 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 204 len: 0 microversion: 2.1 time: 0.126456 Sep 26 10:40:58.828630 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 457/950] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:40:58 2022] DELETE /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 26 10:40:58.838865 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:40:58.840311 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:40:58.846587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:58.847081 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:58.847535 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:58.848219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:40:58.848676 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:40:58.849107 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:40:58.988913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:40:58.997617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f61561b1-3d60-4235-9e32-3e64da757e46 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1514 microversion: 2.1 time: 0.164122 Sep 26 10:40:59.009198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 494/951] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:40:58 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:00.021505 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:00.022242 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:00.028825 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:00.029327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:00.029814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:00.030576 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:00.031087 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:00.031534 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:00.170481 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:00.178184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-14e0fe50-cc06-4984-b32b-cad3f41cd196 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1514 microversion: 2.1 time: 0.160825 Sep 26 10:41:00.178748 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 458/952] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:00 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:01.086525 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-dbfa3243-faaf-4fc5-ad3b-7bffd7aefdeb req-e934f55b-57de-4e81-9e19-bb7de54b9932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da5ce05-abb7-42fa-8dba-d17dc3abd236", "name": "network-vif-deleted", "tag": "7e50437a-eb56-403a-84f2-ba7d8567bc77"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:41:01.097883 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-dbfa3243-faaf-4fc5-ad3b-7bffd7aefdeb req-e934f55b-57de-4e81-9e19-bb7de54b9932 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:01.098426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-dbfa3243-faaf-4fc5-ad3b-7bffd7aefdeb req-e934f55b-57de-4e81-9e19-bb7de54b9932 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:01.098863 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-dbfa3243-faaf-4fc5-ad3b-7bffd7aefdeb req-e934f55b-57de-4e81-9e19-bb7de54b9932 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:01.110556 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-dbfa3243-faaf-4fc5-ad3b-7bffd7aefdeb req-e934f55b-57de-4e81-9e19-bb7de54b9932 service nova] Creating event network-vif-deleted:7e50437a-eb56-403a-84f2-ba7d8567bc77 for instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 on hv-cinder-84456 Sep 26 10:41:01.116041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-dbfa3243-faaf-4fc5-ad3b-7bffd7aefdeb req-e934f55b-57de-4e81-9e19-bb7de54b9932 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Sep 26 10:41:01.116647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 495/953] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:41:01.202657 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:01.203316 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:01.210254 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:01.211032 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:01.211729 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:01.212814 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:01.213389 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:01.214201 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:01.247924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:01.248416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:01.248853 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:01.249307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.objects.instance [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lazy-loading 'fault' on Instance uuid 4da5ce05-abb7-42fa-8dba-d17dc3abd236 {{(pid=127055) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:41:01.293716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57fa5ee68e6f48e982c312e6bb3a6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e71ac778bf24f779d6d4c8c5de7e528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:01.301653 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-194def40-9ffa-409a-a276-fb88fc661ca9 tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 200 len: 1309 microversion: 2.1 time: 0.103317 Sep 26 10:41:01.302455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 459/954] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:01 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:02.326632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:02.327337 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] [instance: 4da5ce05-abb7-42fa-8dba-d17dc3abd236] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:02.333387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:02.333873 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:02.334341 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:02.335031 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:02.335484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:02.335931 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:02.349239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] HTTP exception thrown: Instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 could not be found. Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Request method failure captured: Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 HTTP/1.1 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYFAQkzqKmtc3iby0B4QvAfMqBBU1w3nF3bMg6seEHiaxisYM_jO1MKbLIigq--W2YTsr1Ep_SZYCL2uDXFrZclAhMjqAgql0ndcoZR1N8AIlxkZVnSTw2-ZB3lBmla3Clq7FH7ckBRuiP5UU7j7XEdApbhXujl6jVswPzoceZ7fgk0 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 3e71ac778bf24f779d6d4c8c5de7e528 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-VolumesSnapshotTestJSON-722631633 Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:41:02.350860 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/3e71ac778bf24f779d6d4c8c5de7e528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_3e71ac778bf24f779d6d4c8c5de7e528", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e71ac778bf24f779d6d4c8c5de7e528"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/3e71ac778bf24f779d6d4c8c5de7e528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-VolumesSnapshotTestJSON-722631633 Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 3e71ac778bf24f779d6d4c8c5de7e528 Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-722631633 Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-VolumesSnapshotTestJSON-722631633-project Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 57fa5ee68e6f48e982c312e6bb3a6ce6 Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-VolumesSnapshotTestJSON-722631633-project Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 could not be found. Sep 26 10:41:02.352589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '4da5ce05-abb7-42fa-8dba-d17dc3abd236'} Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 could not be found. Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:41:02.353422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 could not be found. Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 could not be found. Sep 26 10:41:02.355593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:41:02.356982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] Returning 404 to user: Instance 4da5ce05-abb7-42fa-8dba-d17dc3abd236 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:41:02.356982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-29c8eb2d-e80c-4f51-b847-0063433b3c6f tempest-VolumesSnapshotTestJSON-722631633 tempest-VolumesSnapshotTestJSON-722631633-project] 10.222.0.49 "GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236" status: 404 len: 111 microversion: 2.1 time: 0.030423 Sep 26 10:41:02.356982 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 496/955] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:02 2022] GET /compute/v2.1/servers/4da5ce05-abb7-42fa-8dba-d17dc3abd236 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:41:31.610537 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:31.611354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:31.801502 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-0b320e43-32dd-4866-9a6b-c9e84653da08 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Action: 'create', calling method: .version_select at 0x7fbadafe43a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1814152384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWQT7uJnu3bDP8pxDjYyq/+V/qr/n6keDSguf/ZzLLFTlC5bTRJgKxFe0iJFzup2GSZCPKhTNxw4oIQ+SH9AhDFJ33ZICz3jNjz1Cf3A9dyZ1CLeApYYRNKxFlOBUNaLw=="}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:41:31.818684 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-0b320e43-32dd-4866-9a6b-c9e84653da08 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Getting quotas for project b35e6a97e32b426daab0ba663323e8a8. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:41:31.823227 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-0b320e43-32dd-4866-9a6b-c9e84653da08 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Getting quotas for user c1dcec4c0b364d7caa37af361da31b18 and project b35e6a97e32b426daab0ba663323e8a8. Resources: {'key_pairs'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:41:31.847913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-0b320e43-32dd-4866-9a6b-c9e84653da08 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242559 Sep 26 10:41:31.848747 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 460/956] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:41:31 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:41:45.056663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 26 10:41:45.057908 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=8 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:45.058809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:45.346691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-04e1d0a1-48de-4f38-897e-2d6a183f4ccc tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Action: 'create', calling method: .version_select at 0x7fbadb2d6040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-906365057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBN5IKGE809SeC7UOk/AHF3jgG53o+r9aOj2eP4CohIOkmcSLel0H23wS/MnMEEuA8b3nQD4pFz/V+kIm3qEZ1DG+nRHzWRscD26hJ+oJXUI5GX3ssl+NaNd2yeJ1zqHuQ=="}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:41:45.366148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-04e1d0a1-48de-4f38-897e-2d6a183f4ccc tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:41:45.371110 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-04e1d0a1-48de-4f38-897e-2d6a183f4ccc tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for user 0561a33fd6984118b1fd221f9eaaeef6 and project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'key_pairs'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:41:45.405313 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-04e1d0a1-48de-4f38-897e-2d6a183f4ccc tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.354249 Sep 26 10:41:45.410463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 497/957] 10.222.0.49 () {60 vars in 1159 bytes} [Mon Sep 26 10:41:45 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:41:50.340149 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=4 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:50.341026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:41:50.345419 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-183372425", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1814152384", "security_groups": [{"name": "tempest-secgroup-smoke-1818063156"}], "networks": [{"uuid": "af47f48f-c46c-40ed-b170-e46263de86e2"}], "block_device_mapping_v2": [{"uuid": "45737850-52a4-41c5-8b6e-cbfb27c4b23c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:41:50.484556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] validate_networks() for [('af47f48f-c46c-40ed-b170-e46263de86e2', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:41:50.876797 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:41:50.877353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:41:50.877926 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:41:50.878572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:41:50.879054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:41:50.889157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:50.889670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:50.890152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:50.890885 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:50.891559 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:50.892751 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:50.910087 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Getting quotas for project b35e6a97e32b426daab0ba663323e8a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:41:50.914183 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Getting quotas for user c1dcec4c0b364d7caa37af361da31b18 and project b35e6a97e32b426daab0ba663323e8a8. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:41:50.977466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:41:50.979672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45737850-52a4-41c5-8b6e-cbfb27c4b23c',volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:41:51.137050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ca451397-5ce4-48b4-abcf-df25200f6bbf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798193 Sep 26 10:41:51.137895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 461/958] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:41:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:41:51.148944 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0e21ae55-c96b-4004-9cec-b473ad5908bf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:51.149575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0e21ae55-c96b-4004-9cec-b473ad5908bf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:51.213515 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0e21ae55-c96b-4004-9cec-b473ad5908bf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:51.221510 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0e21ae55-c96b-4004-9cec-b473ad5908bf tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1088 microversion: 2.1 time: 0.076463 Sep 26 10:41:51.222282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 498/959] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:51 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:52.246679 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:52.247367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:52.255102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:52.255701 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:52.256055 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:52.257080 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:52.258237 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:52.258694 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:52.336287 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:52.345083 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9ba4009d-e6b9-493a-bd54-5863d716af12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1204 microversion: 2.1 time: 0.103094 Sep 26 10:41:52.346052 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 462/960] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:52 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:53.368374 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:53.369175 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:53.378260 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:53.378854 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:53.379386 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:53.380261 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:53.380722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:53.381145 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:53.613520 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:53.626980 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b2e30ca7-1944-4ee8-ba3c-5e9e88726a56 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.262056 Sep 26 10:41:53.628663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 499/961] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:53 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:53.989736 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-0b188ea6-a8c0-4fa7-8e09-0812ee41b8ce req-45558e38-30be-4384-910b-c85e186d8977 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:41:54.001040 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-0b188ea6-a8c0-4fa7-8e09-0812ee41b8ce req-45558e38-30be-4384-910b-c85e186d8977 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:54.001544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-0b188ea6-a8c0-4fa7-8e09-0812ee41b8ce req-45558e38-30be-4384-910b-c85e186d8977 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:54.001994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-0b188ea6-a8c0-4fa7-8e09-0812ee41b8ce req-45558e38-30be-4384-910b-c85e186d8977 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:54.013450 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-0b188ea6-a8c0-4fa7-8e09-0812ee41b8ce req-45558e38-30be-4384-910b-c85e186d8977 service nova] Creating event network-changed:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:41:54.018853 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-0b188ea6-a8c0-4fa7-8e09-0812ee41b8ce req-45558e38-30be-4384-910b-c85e186d8977 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032672 Sep 26 10:41:54.019642 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 463/962] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:41:54.652927 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:54.653542 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:54.660185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:54.660673 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:54.661108 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:54.661832 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:54.662312 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:54.662740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:54.878277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:54.887198 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-39d5de05-dac1-42aa-bfcf-308907fd201b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.238756 Sep 26 10:41:54.887883 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 500/963] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:54 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:41:55.911179 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:55.911888 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:55.918124 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:55.918614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:55.919049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:55.919748 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:55.920197 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:55.920623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:56.057075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:56.064763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-20b46c1d-abbb-45a8-a412-d896fc3e4b12 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.158314 Sep 26 10:41:56.065328 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 464/964] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:55 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:57.088231 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:57.089310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:57.095754 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:57.096242 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:57.096710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:57.097405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:57.097877 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:57.098342 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:57.229019 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:57.236893 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-dbe85bb1-d6eb-4643-96c1-158da9592e5c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.152687 Sep 26 10:41:57.237463 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 501/965] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:57 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:41:58.260029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:58.260648 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:58.267198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:58.267691 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:58.268135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:58.268852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:58.269308 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:58.269738 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:58.404172 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:58.411842 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-49af6fa9-668b-49dc-a9c0-279fea91bdbd tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.155786 Sep 26 10:41:58.412414 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 465/966] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:58 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:41:59.436041 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:41:59.436660 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:41:59.443095 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:59.443587 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:59.444031 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:59.444760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:41:59.445222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:41:59.445651 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:41:59.575697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:41:59.583422 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-053f0806-dbaa-4ba5-adfe-183789e3c714 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.151966 Sep 26 10:41:59.583999 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 502/967] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:41:59 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:00.606857 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:00.607474 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:00.613869 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:00.614387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:00.614824 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:00.615761 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:00.616214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:00.616637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:00.750354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:00.757911 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-baae197b-947e-4d91-9b2d-d0804307298a tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.155527 Sep 26 10:42:00.758434 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 466/968] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:00 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:01.780630 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:01.781257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:01.783565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=6 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:01.788836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:01.789325 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:01.789768 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:01.790496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:01.790957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:01.791387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:01.920043 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:01.927664 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-dfa3b6a9-a534-43c4-9a7d-1e972ebab3e3 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.150896 Sep 26 10:42:01.928228 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 503/969] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:01 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:02.890865 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-140145801", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-906365057", "security_groups": [{"name": "tempest-secgroup-smoke-1388718423"}], "block_device_mapping_v2": [{"uuid": "458f336c-f5bd-4e16-a139-0397fbfd30f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "590c7da6-7b88-4882-abbb-133a0426748c"}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:42:02.902372 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:02.903536 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:02.950548 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:02.951166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:02.957793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:02.958324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:02.958770 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:02.959475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:02.959933 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:02.960356 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:03.043026 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] validate_networks() for [('590c7da6-7b88-4882-abbb-133a0426748c', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:42:03.201478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:03.210055 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-74150c67-712b-4a37-b61e-5ca2c391e1b9 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.263258 Sep 26 10:42:03.223666 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 504/970] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:02 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:42:03.228477 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-5961e821-3a6d-479e-85bf-ab893ecd7174 req-b74b42f8-8cba-4a2a-89c5-bfb241e67d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "name": "network-vif-plugged", "status": "completed", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:42:03.238154 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-5961e821-3a6d-479e-85bf-ab893ecd7174 req-b74b42f8-8cba-4a2a-89c5-bfb241e67d50 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:03.238631 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-5961e821-3a6d-479e-85bf-ab893ecd7174 req-b74b42f8-8cba-4a2a-89c5-bfb241e67d50 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:03.239119 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-5961e821-3a6d-479e-85bf-ab893ecd7174 req-b74b42f8-8cba-4a2a-89c5-bfb241e67d50 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:03.250399 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-5961e821-3a6d-479e-85bf-ab893ecd7174 req-b74b42f8-8cba-4a2a-89c5-bfb241e67d50 service nova] Creating event network-vif-plugged:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:42:03.255497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-5961e821-3a6d-479e-85bf-ab893ecd7174 req-b74b42f8-8cba-4a2a-89c5-bfb241e67d50 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 Sep 26 10:42:03.256099 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 505/971] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:42:03.533573 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:42:03.534007 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:42:03.534514 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:42:03.534928 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:42:03.535362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:42:03.544206 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:03.544695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:03.545140 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:03.545870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:03.546353 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:03.546781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:03.565276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:42:03.569376 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for user 0561a33fd6984118b1fd221f9eaaeef6 and project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:42:03.630208 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:42:03.632330 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='458f336c-f5bd-4e16-a139-0397fbfd30f6',volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:42:03.765478 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4faf6681-5709-42c8-aa8c-89eb062e0faf tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878478 Sep 26 10:42:03.772219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 467/972] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:42:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:42:03.779617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-92f13ff1-13f3-420f-96b6-14ceca6e3047 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:03.780605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-92f13ff1-13f3-420f-96b6-14ceca6e3047 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:03.837544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-92f13ff1-13f3-420f-96b6-14ceca6e3047 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:03.845265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-92f13ff1-13f3-420f-96b6-14ceca6e3047 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1093 microversion: 2.1 time: 0.070825 Sep 26 10:42:03.846074 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 506/973] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:03 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:04.236404 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:04.236999 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:04.243780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:04.244265 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:04.244698 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:04.245387 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:04.245840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:04.246303 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:04.387425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:04.395724 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-4f8ce969-90c5-43e1-aa71-8d639b939410 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1260 microversion: 2.1 time: 0.163759 Sep 26 10:42:04.396309 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 468/974] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:04 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:04.868271 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:04.868821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:04.878085 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:04.878576 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:04.879015 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:04.879710 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:04.880166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:04.880594 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:04.939841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:04.947478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-3ee53d46-8815-4663-8f2a-306b301863ef tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1191 microversion: 2.1 time: 0.083439 Sep 26 10:42:04.948039 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 507/975] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:04 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:05.420755 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:05.421487 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:05.428357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:05.428871 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:05.429373 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:05.430487 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:05.430946 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:05.431378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:05.658972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:05.666786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-e4b5a273-1300-4247-b4f2-8ddfb3f4522d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1443 microversion: 2.1 time: 0.251937 Sep 26 10:42:05.667354 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 469/976] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:05 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1443 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:05.689000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:05.689662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:05.695663 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:05.696132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:05.696611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:05.697282 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:05.697751 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:05.698251 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:05.932560 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:05.942691 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ef752582-f85e-4196-8ce6-52e1c06b0547 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1443 microversion: 2.1 time: 0.257486 Sep 26 10:42:05.943280 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 508/977] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:05 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1443 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:05.973169 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:05.973888 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:05.979923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:05.980500 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:05.981018 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:05.981785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:05.982458 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:05.982897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:06.051408 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:06.060002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-1ac4abd8-c806-4fae-a336-8e91099ad5f3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1197 microversion: 2.1 time: 0.090258 Sep 26 10:42:06.060575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 470/978] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:05 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:06.938360 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-9c74f817-9dca-4e56-adfe-26234c11f87c req-a04ff788-3eb5-458a-a16d-67ab992ea9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76698be8-9cd8-48af-8dac-1f621de79411", "tag": "72c6abff-287d-40c6-9fb0-4342b81e55fd"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:42:06.953792 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-9c74f817-9dca-4e56-adfe-26234c11f87c req-a04ff788-3eb5-458a-a16d-67ab992ea9d3 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:06.954312 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-9c74f817-9dca-4e56-adfe-26234c11f87c req-a04ff788-3eb5-458a-a16d-67ab992ea9d3 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:06.954750 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-9c74f817-9dca-4e56-adfe-26234c11f87c req-a04ff788-3eb5-458a-a16d-67ab992ea9d3 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:06.975672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-9c74f817-9dca-4e56-adfe-26234c11f87c req-a04ff788-3eb5-458a-a16d-67ab992ea9d3 service nova] Creating event network-changed:72c6abff-287d-40c6-9fb0-4342b81e55fd for instance 76698be8-9cd8-48af-8dac-1f621de79411 on hv-cinder-84456 Sep 26 10:42:06.981766 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-9c74f817-9dca-4e56-adfe-26234c11f87c req-a04ff788-3eb5-458a-a16d-67ab992ea9d3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046439 Sep 26 10:42:06.982734 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 509/979] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:42:07.089252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:07.089878 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:07.099429 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:07.099930 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:07.100366 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:07.101073 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:07.101710 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:07.102159 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:07.493851 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:07.502583 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d3c9455d-a1dd-4b18-9417-5e97a8c8d59b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.423021 Sep 26 10:42:07.503252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 471/980] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:07 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:08.015330 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-bc1e75ed-69b5-4d3a-9106-36297564dc08 req-15d0fcb3-4ee1-4500-9c90-ac240158c61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:42:08.031681 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-bc1e75ed-69b5-4d3a-9106-36297564dc08 req-15d0fcb3-4ee1-4500-9c90-ac240158c61d service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:08.032484 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-bc1e75ed-69b5-4d3a-9106-36297564dc08 req-15d0fcb3-4ee1-4500-9c90-ac240158c61d service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:08.032924 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-bc1e75ed-69b5-4d3a-9106-36297564dc08 req-15d0fcb3-4ee1-4500-9c90-ac240158c61d service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:08.044503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-bc1e75ed-69b5-4d3a-9106-36297564dc08 req-15d0fcb3-4ee1-4500-9c90-ac240158c61d service nova] Creating event network-changed:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:42:08.049473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-bc1e75ed-69b5-4d3a-9106-36297564dc08 req-15d0fcb3-4ee1-4500-9c90-ac240158c61d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039375 Sep 26 10:42:08.053518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 510/981] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:42:08.526187 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:08.527502 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:08.534198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:08.534952 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:08.535455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:08.536446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:08.536974 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:08.537466 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:08.767994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:08.776181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3d63b3b2-b8b5-487e-9ed6-cac81a259832 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.253894 Sep 26 10:42:08.776752 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 472/982] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:08 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:09.801215 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:09.802096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:09.808910 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:09.809408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:09.809852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:09.810588 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:09.811052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:09.811485 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:09.940569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:09.948298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-561c4f51-d6f8-40f1-b4ed-ee9afcfe55c8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.151307 Sep 26 10:42:09.948866 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 511/983] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:09 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:42:10.971957 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:10.972583 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:10.979001 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:10.979482 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:10.979925 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:10.980612 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:10.981604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:10.982046 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:11.120406 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:11.127962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b0247d99-8fb1-4320-a1ec-fb3f482447d7 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.160337 Sep 26 10:42:11.128516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 473/984] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:10 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:42:12.150911 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:12.151446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:12.157857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:12.158377 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:12.158820 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:12.159557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:12.159966 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:12.160391 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:12.288137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:12.296226 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6c0a7b3a-7a73-4363-888a-0d00a713997f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.149274 Sep 26 10:42:12.296787 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 512/985] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:12 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:13.319872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:13.320485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:13.327559 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:13.328045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:13.328480 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:13.329172 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:13.329627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:13.330078 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:13.459050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:13.466628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a6ade73f-d23d-4b6c-8d3b-a03f72e7872d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.150628 Sep 26 10:42:13.467388 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 474/986] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:13 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:14.489433 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:14.489998 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:14.492219 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:14.497984 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:14.498498 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:14.498941 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:14.499640 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:14.500096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:14.500521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:14.631503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:14.639216 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f65906c3-d357-42fb-8819-d716ee8b6a1a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.153965 Sep 26 10:42:14.639779 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 513/987] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:14 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:15.663082 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:15.663735 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:15.665771 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:15.666606 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:15.673212 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:15.673703 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:15.674168 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:15.674869 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:15.675320 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:15.675741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:15.807902 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:15.815559 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8367471a-510a-44cb-96f3-aff3ccabce73 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.156390 Sep 26 10:42:15.816117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 475/988] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:15 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:16.838104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:16.838722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:16.841125 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:16.846426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:16.846919 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:16.847361 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:16.848052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:16.848509 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:16.848940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:16.852174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=73 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:16.982752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:16.990566 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0f7aa1bc-f288-42a9-975d-3ff256fa18e3 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.156089 Sep 26 10:42:16.991128 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 514/989] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:16 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:17.216272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-103c66b6-fb47-4280-a83d-de745a8218ba req-7a25df12-2531-40d7-a1a9-b96afc7657d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76698be8-9cd8-48af-8dac-1f621de79411", "name": "network-vif-plugged", "status": "completed", "tag": "72c6abff-287d-40c6-9fb0-4342b81e55fd"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:42:17.226460 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-103c66b6-fb47-4280-a83d-de745a8218ba req-7a25df12-2531-40d7-a1a9-b96afc7657d7 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:17.226950 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-103c66b6-fb47-4280-a83d-de745a8218ba req-7a25df12-2531-40d7-a1a9-b96afc7657d7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:17.227378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-103c66b6-fb47-4280-a83d-de745a8218ba req-7a25df12-2531-40d7-a1a9-b96afc7657d7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:17.239222 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-103c66b6-fb47-4280-a83d-de745a8218ba req-7a25df12-2531-40d7-a1a9-b96afc7657d7 service nova] Creating event network-vif-plugged:72c6abff-287d-40c6-9fb0-4342b81e55fd for instance 76698be8-9cd8-48af-8dac-1f621de79411 on hv-cinder-84456 Sep 26 10:42:17.244410 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-103c66b6-fb47-4280-a83d-de745a8218ba req-7a25df12-2531-40d7-a1a9-b96afc7657d7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Sep 26 10:42:17.245068 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 476/990] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:42:18.014518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:18.015132 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:18.021551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:18.022044 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:18.022494 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:18.023185 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:18.023632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:18.024050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:18.157308 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:18.164902 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-ad558ff0-4b63-4844-9712-17a6d68a35a4 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1265 microversion: 2.1 time: 0.154942 Sep 26 10:42:18.165461 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 515/991] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:18 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:19.189912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:19.190674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:19.196756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:19.197267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:19.197704 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:19.198413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:19.198874 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:19.199298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:19.328862 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:19.336677 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c9d216f7-54e2-46eb-a2af-4611a16eae99 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1451 microversion: 2.1 time: 0.151537 Sep 26 10:42:19.337248 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 477/992] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:19 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:19.359565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:42:19.360181 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:42:19.366857 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:19.367344 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:19.367789 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:19.368486 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:19.368940 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:19.369369 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:19.499905 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:42:19.507872 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9555ab0a-4cab-4ebf-891d-b84def616da0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1451 microversion: 2.1 time: 0.152663 Sep 26 10:42:19.508441 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 516/993] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:42:19 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:42:21.093934 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-4413fe45-3a3c-428c-91c0-6d6b0a3f802e req-7b7dac33-c8b0-4b23-9f56-40c6eff389c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76698be8-9cd8-48af-8dac-1f621de79411", "tag": "72c6abff-287d-40c6-9fb0-4342b81e55fd"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:42:21.099441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:21.105034 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-4413fe45-3a3c-428c-91c0-6d6b0a3f802e req-7b7dac33-c8b0-4b23-9f56-40c6eff389c7 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:42:21.105515 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-4413fe45-3a3c-428c-91c0-6d6b0a3f802e req-7b7dac33-c8b0-4b23-9f56-40c6eff389c7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:42:21.106737 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-4413fe45-3a3c-428c-91c0-6d6b0a3f802e req-7b7dac33-c8b0-4b23-9f56-40c6eff389c7 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:42:21.111033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=87 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:42:21.120054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-4413fe45-3a3c-428c-91c0-6d6b0a3f802e req-7b7dac33-c8b0-4b23-9f56-40c6eff389c7 service nova] Creating event network-changed:72c6abff-287d-40c6-9fb0-4342b81e55fd for instance 76698be8-9cd8-48af-8dac-1f621de79411 on hv-cinder-84456 Sep 26 10:42:21.125175 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-4413fe45-3a3c-428c-91c0-6d6b0a3f802e req-7b7dac33-c8b0-4b23-9f56-40c6eff389c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035601 Sep 26 10:42:21.126051 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 478/994] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:44:05.480239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:05.480900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:05.482885 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=5 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:05.483528 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=17 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:05.484899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 10:44:05.485061 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Mon Sep 26 10:44:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c/action (ip 10.222.0.49) !!! Sep 26 10:44:05.486809 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 26 10:44:05.486969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Mon Sep 26 10:44:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c/action (ip 10.222.0.49) !!! Sep 26 10:44:05.498496 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:05.498975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:05.499408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:05.500096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:05.500544 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:05.500963 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:05.524062 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lazy-loading 'flavor' on Instance uuid 6ae4f8b3-717f-4216-b14d-532a06968c8c {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:44:05.595551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d371ee7d-bf6f-4a70-aebb-1f14a76f4668 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "POST /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c/action" status: 202 len: 0 microversion: 2.1 time: 0.121341 Sep 26 10:44:05.596111 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 517/995] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:44:05 2022] POST /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:44:05.603319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38405daf-6dd1-4766-8189-a95519ec6e73] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 26 10:44:05.603942 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:05.604738 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:05.610075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:05.610793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:05.618923 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:05.619402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:05.619840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:05.620571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:05.620998 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:05.621427 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:05.800997 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:05.809314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-37ad534b-3ab2-4ede-b2d9-9b7b979953a0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.207975 Sep 26 10:44:05.809880 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 479/996] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:05 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:06.833950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:06.834700 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:06.840976 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:06.841467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:06.841907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:06.842631 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:06.843089 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:06.843516 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:07.044380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:07.052122 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-47558f96-2e5e-4e6b-b141-8ff42acf35ce tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.223307 Sep 26 10:44:07.052725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 518/997] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:06 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:08.077082 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:08.077628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:08.088547 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:08.089063 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:08.089497 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:08.090223 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:08.090675 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:08.091144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:08.094522 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO oslo.messaging._drivers.impl_rabbit [-] [38405daf-6dd1-4766-8189-a95519ec6e73] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42108. Sep 26 10:44:08.220349 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:08.227852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b89a9090-db75-45fa-87eb-a9e64688a4f6 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.154796 Sep 26 10:44:08.228416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 480/998] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:08 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:09.251690 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:09.252246 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:09.259069 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:09.259553 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:09.259986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:09.260672 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:09.261129 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:09.261559 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:09.394589 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:09.402953 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fd796cb3-48c3-402b-b394-cbd9cfba4fbe tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.155312 Sep 26 10:44:09.403547 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 519/999] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:09 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:10.426324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:10.426948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:10.433840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:10.434359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:10.434803 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:10.435495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:10.435954 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:10.436379 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:10.566417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:10.575453 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-10014cd1-090e-4507-a7c3-477f477afd7c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.153061 Sep 26 10:44:10.576029 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 481/1000] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:10 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:11.598648 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:11.599291 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:11.605669 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:11.606190 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:11.606628 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:11.607307 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:11.607758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:11.608179 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:11.735715 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:11.743689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a5735d18-4ac7-4f5c-b879-767db7192674 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.148914 Sep 26 10:44:11.744254 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 520/1001] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:11 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:12.767486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:12.768079 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:12.774883 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:12.775361 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:12.775785 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:12.776463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:12.776912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:12.777329 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:12.908815 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:12.916981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ac1fd7b3-ae38-4955-b18b-8af2b5f3a16b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.153394 Sep 26 10:44:12.917540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 482/1002] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:12 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:13.940273 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:13.940891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:13.946894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:13.947380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:13.947818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:13.948512 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:13.948969 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:13.949398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:14.078981 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:14.088162 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-78d93af5-9f1f-4ace-acaa-fdc40f10190d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.151886 Sep 26 10:44:14.088733 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 521/1003] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:13 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:15.112357 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:15.112913 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:15.119938 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:15.120412 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:15.120838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:15.121517 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:15.121962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:15.122403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:15.252056 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:15.259734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-18619aa7-bd52-487d-beb9-85d1fc417859 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.151366 Sep 26 10:44:15.260302 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 483/1004] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:15 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:16.282521 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:16.283109 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:16.289577 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:16.290087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:16.290522 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:16.291233 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:16.291678 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:16.292098 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:16.488394 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:16.496618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-61cfd01a-45ff-4575-9dfe-0ca12f5c6d0e tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.217992 Sep 26 10:44:16.497387 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 522/1005] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:16 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:17.520359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:17.521596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:17.527996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:17.528475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:17.528904 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:17.529582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:17.530045 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:17.530472 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:17.662959 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:17.670683 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7172f6fe-a8df-4a24-b3d6-64e9ff81178d tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.154220 Sep 26 10:44:17.671257 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 484/1006] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:17 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:18.423190 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:18.424084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:18.431557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:18.432045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:18.432643 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:18.433176 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:18.433635 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:18.434083 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:18.460586 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:44:18.537647 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-45c48951-6cbc-46f8-9883-d4075fad680d tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 204 len: 0 microversion: 2.1 time: 0.118937 Sep 26 10:44:18.538276 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 523/1007] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:44:18 2022] DELETE /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:44:18.549178 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:18.549793 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:18.556894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:18.557372 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:18.557802 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:18.558516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:18.558964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:18.559384 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:18.691217 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:18.694400 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:18.695100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:18.699674 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-99e79f14-1b53-4b0a-86f2-0f4026b2b6c9 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1576 microversion: 2.1 time: 0.156527 Sep 26 10:44:18.700246 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 485/1008] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:18 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:18.701834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:18.702366 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:18.702834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:18.703536 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:18.704087 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:18.704508 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:18.857997 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:18.867028 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0c7ca819-11b0-4341-ae94-fb93d4096556 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.177492 Sep 26 10:44:18.867611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 524/1009] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:18 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:44:19.723036 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:19.724338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:19.731374 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:19.731868 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:19.732327 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:19.733031 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:19.733488 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:19.733916 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:19.871671 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:19.879350 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-44bae7ae-6437-4c53-915c-f10288058106 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1576 microversion: 2.1 time: 0.160204 Sep 26 10:44:19.880416 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 486/1010] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:19 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:19.890855 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:19.891944 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:19.899954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:19.900518 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:19.900958 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:19.901650 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:19.902601 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:19.903032 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:20.036634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:20.044281 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-07c68040-10eb-4588-a741-cde26b8dc190 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1569 microversion: 2.1 time: 0.157572 Sep 26 10:44:20.044840 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 525/1011] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:19 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:20.066994 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:20.068251 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:20.074102 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:20.074593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:20.075030 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:20.075725 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:20.076181 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:20.076604 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:20.104175 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127055) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 26 10:44:20.169328 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-eeb860cf-14ec-49bf-9f0c-e5019e83b86c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "POST /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c/action" status: 202 len: 0 microversion: 2.1 time: 0.106191 Sep 26 10:44:20.169927 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 487/1012] 10.222.0.49 () {60 vars in 1278 bytes} [Mon Sep 26 10:44:20 2022] POST /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:44:20.178568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:20.179187 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:20.185611 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:20.186136 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:20.186575 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:20.187403 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:20.187871 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:20.188298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:20.325639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:20.334050 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4e346093-3a96-4e8b-ba0e-7cd5f19f86a2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1577 microversion: 2.1 time: 0.159841 Sep 26 10:44:20.334615 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 526/1013] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:20 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:20.905986 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:20.906780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:20.913711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:20.914367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:20.914896 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:20.915703 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:20.916287 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:20.916826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:21.009969 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:21.024799 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-499c1cc8-9b1f-4813-bf83-21ea1948f92a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1508 microversion: 2.1 time: 0.123230 Sep 26 10:44:21.037002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 488/1014] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:20 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1508 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:21.358276 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:21.359486 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:21.365060 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-abf87b10-df12-4ecf-a8d9-33198a9160e2 req-a8a28d15-029f-4d37-b62b-6e7148d2577c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76698be8-9cd8-48af-8dac-1f621de79411", "name": "network-vif-deleted", "tag": "72c6abff-287d-40c6-9fb0-4342b81e55fd"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:21.370634 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:21.371388 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:21.372006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:21.372940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:21.373565 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:21.374223 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:21.376835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-abf87b10-df12-4ecf-a8d9-33198a9160e2 req-a8a28d15-029f-4d37-b62b-6e7148d2577c service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:21.377408 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-abf87b10-df12-4ecf-a8d9-33198a9160e2 req-a8a28d15-029f-4d37-b62b-6e7148d2577c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:21.377850 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-abf87b10-df12-4ecf-a8d9-33198a9160e2 req-a8a28d15-029f-4d37-b62b-6e7148d2577c service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:21.398705 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-abf87b10-df12-4ecf-a8d9-33198a9160e2 req-a8a28d15-029f-4d37-b62b-6e7148d2577c service nova] Creating event network-vif-deleted:72c6abff-287d-40c6-9fb0-4342b81e55fd for instance 76698be8-9cd8-48af-8dac-1f621de79411 on hv-cinder-84456 Sep 26 10:44:21.406115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-abf87b10-df12-4ecf-a8d9-33198a9160e2 req-a8a28d15-029f-4d37-b62b-6e7148d2577c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109138 Sep 26 10:44:21.407502 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 527/1015] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:44:21.539852 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:21.551263 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-13b1a4b0-ba6c-441f-9cd4-5df5f930c309 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1519 microversion: 2.1 time: 0.197436 Sep 26 10:44:21.552406 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 489/1016] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:21 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:22.060948 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:22.061698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:22.068064 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:22.068629 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:22.069139 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:22.069906 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:22.070569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:22.071000 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:22.102879 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:22.103370 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:22.103808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:22.104256 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.objects.instance [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lazy-loading 'fault' on Instance uuid 76698be8-9cd8-48af-8dac-1f621de79411 {{(pid=127056) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 26 10:44:22.150147 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:22.166792 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-074d728e-cc4b-4c5b-bd1f-bedda161a750 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 200 len: 1229 microversion: 2.1 time: 0.110108 Sep 26 10:44:22.167475 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 528/1017] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:22 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:22.576299 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:22.576915 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:22.583846 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:22.584334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:22.584772 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:22.585464 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:22.585924 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:22.586378 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:22.783858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:22.792777 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3b7d5fd6-4d2e-4ab9-bf53-ec87d3ed30b5 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.220358 Sep 26 10:44:22.793363 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 490/1018] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:22 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:23.191687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:23.192852 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:23.199117 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.199604 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.200036 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.200721 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.201175 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.201617 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.215468 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] HTTP exception thrown: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Request method failure captured: Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 HTTP/1.1 Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYHk-wynvkyn-EP_LGdfpf_NCtXzaJCLY04mD7Ftj_qY4axhOeTRuTDHFae5PpOxkjDHePMALvwg4a2Ke7BgjBUPCzrrIU-IQhYl8if5YKDRZymLrBswtk4ENSr-rlZXWOE2xlGJNT39U7-_1c74klXva0CjReSb4eHdi0Ptlh3e7YA Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:44:23.217059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1e0f8c6af4d3456c9d700088cd8f5eb5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 0561a33fd6984118b1fd221f9eaaeef6 Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:44:23.218726 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '76698be8-9cd8-48af-8dac-1f621de79411'} Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:44:23.228146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:44:23.229791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:44:23.231887 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Returning 404 to user: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:44:23.231887 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-c8e7f9e2-d771-4a4a-bc29-5b01067bc0fe tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 404 len: 111 microversion: 2.1 time: 0.030987 Sep 26 10:44:23.231887 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 529/1019] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:23 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:44:23.273236 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-782065070", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-906365057", "security_groups": [{"name": "tempest-secgroup-smoke-1388718423"}], "block_device_mapping_v2": [{"uuid": "458f336c-f5bd-4e16-a139-0397fbfd30f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "590c7da6-7b88-4882-abbb-133a0426748c"}]}} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:23.385520 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.network.neutron [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] validate_networks() for [('590c7da6-7b88-4882-abbb-133a0426748c', None, None, None, None, None)] {{(pid=127055) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:44:23.739530 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-35b89731-55b4-4cb8-be7b-191cb6516909 req-2b575018-a8c0-4fec-ab17-76dd21dd1fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "name": "network-vif-unplugged", "status": "completed", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:23.749167 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-35b89731-55b4-4cb8-be7b-191cb6516909 req-2b575018-a8c0-4fec-ab17-76dd21dd1fbc service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.749683 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-35b89731-55b4-4cb8-be7b-191cb6516909 req-2b575018-a8c0-4fec-ab17-76dd21dd1fbc service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.750263 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-35b89731-55b4-4cb8-be7b-191cb6516909 req-2b575018-a8c0-4fec-ab17-76dd21dd1fbc service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.762551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-35b89731-55b4-4cb8-be7b-191cb6516909 req-2b575018-a8c0-4fec-ab17-76dd21dd1fbc service nova] Creating event network-vif-unplugged:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:44:23.767514 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-35b89731-55b4-4cb8-be7b-191cb6516909 req-2b575018-a8c0-4fec-ab17-76dd21dd1fbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092984 Sep 26 10:44:23.768476 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 530/1020] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:44:23.817892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:23.818653 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:23.823409 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Flavor limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:44:23.823899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Image limits 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:44:23.824571 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Flavor pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:44:23.824843 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.824967 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Image pref 0:0:0 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:44:23.825326 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.825446 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.virt.hardware [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127055) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:44:23.825757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.826478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.826932 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.827353 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.834614 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.835090 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.835516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.836231 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:23.836681 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:23.837099 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:23.845105 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:23.854006 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:44:23.858137 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.quota [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for user 0561a33fd6984118b1fd221f9eaaeef6 and project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'ram', 'cores', 'instances'} {{(pid=127055) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:44:23.917058 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Going to run 1 instances... {{(pid=127055) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:44:23.919262 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='458f336c-f5bd-4e16-a139-0397fbfd30f6',volume_size=None,volume_type=None)] {{(pid=127055) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:44:23.971336 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:23.979986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-9f8a69aa-1438-4b61-ba42-f7f5f9e44e8b tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.167145 Sep 26 10:44:23.980785 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 531/1021] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:23 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:44:24.046391 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-54f50d21-406a-4a37-acb3-619e5539d625 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.777071 Sep 26 10:44:24.047160 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 491/1022] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:44:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:44:24.058193 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1225cb63-75e5-4b48-bba3-ee5a026e5cf1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:24.058810 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1225cb63-75e5-4b48-bba3-ee5a026e5cf1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:24.114134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1225cb63-75e5-4b48-bba3-ee5a026e5cf1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:24.121209 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1225cb63-75e5-4b48-bba3-ee5a026e5cf1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1093 microversion: 2.1 time: 0.066902 Sep 26 10:44:24.121861 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 532/1023] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:24 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:25.005441 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:25.006013 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:25.012066 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:25.012552 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:25.012990 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:25.013676 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:25.014163 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:25.014592 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:25.143916 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:25.145121 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:25.146244 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:25.152478 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:25.152970 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:25.153410 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:25.154137 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:25.154516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-52db8bed-74df-4259-b11c-5f2990d6fe36 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.153447 Sep 26 10:44:25.154642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:25.155017 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:25.155297 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 492/1024] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:24 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:25.253068 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:25.260887 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-855ebed4-8e1f-42ad-88cd-19e67de615ea tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1199 microversion: 2.1 time: 0.120811 Sep 26 10:44:25.261596 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 533/1025] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:25 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1199 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:26.179222 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:26.179786 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:26.186277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:26.186759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:26.187191 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:26.187890 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:26.188338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:26.188759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:26.283540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:26.284167 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:26.291637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:26.292135 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:26.292579 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:26.293289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:26.293752 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:26.294221 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:26.412362 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:26.420375 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-a3a4c576-7dbf-4355-aabd-e5248633a47c tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.245151 Sep 26 10:44:26.420953 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 493/1026] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:26 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:26.556642 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:26.564270 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6bce64cc-32e5-40d0-8fe6-7005190ad325 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.284775 Sep 26 10:44:26.564835 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 534/1027] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:26 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:44:26.763252 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-6c88b12c-158b-4520-8eeb-2f2872367e7e req-90bad9c5-40d5-4fa5-a431-f392520cafe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37138afb-0a09-496d-8ad4-b1f3039ada7f", "tag": "68985c50-cfe2-4ac1-96af-9ccabd306e86"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:26.774627 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-6c88b12c-158b-4520-8eeb-2f2872367e7e req-90bad9c5-40d5-4fa5-a431-f392520cafe9 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:26.775402 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-6c88b12c-158b-4520-8eeb-2f2872367e7e req-90bad9c5-40d5-4fa5-a431-f392520cafe9 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:26.776135 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-6c88b12c-158b-4520-8eeb-2f2872367e7e req-90bad9c5-40d5-4fa5-a431-f392520cafe9 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:26.791391 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-6c88b12c-158b-4520-8eeb-2f2872367e7e req-90bad9c5-40d5-4fa5-a431-f392520cafe9 service nova] Creating event network-changed:68985c50-cfe2-4ac1-96af-9ccabd306e86 for instance 37138afb-0a09-496d-8ad4-b1f3039ada7f on hv-cinder-84456 Sep 26 10:44:26.797463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-6c88b12c-158b-4520-8eeb-2f2872367e7e req-90bad9c5-40d5-4fa5-a431-f392520cafe9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038918 Sep 26 10:44:26.798508 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 494/1028] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:44:27.443239 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:27.443867 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:27.450355 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:27.450842 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:27.451277 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:27.451973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:27.452425 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:27.452849 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:27.588740 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:27.589544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:27.596267 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:27.596833 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:27.597274 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:27.598646 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:27.599123 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:27.599550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:27.692423 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:27.700335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-983fcbb1-b554-48fd-86f1-b01b8e8dbb39 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.260954 Sep 26 10:44:27.700828 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 535/1029] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:27 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:27.838872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:27.842359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:27.847390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3b685928-14d2-463a-be95-f4f091707ddd tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.262923 Sep 26 10:44:27.848521 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 495/1030] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:27 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:44:28.723938 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:28.724550 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:28.730949 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:28.731427 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:28.731858 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:28.732540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:28.732992 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:28.733414 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:28.863460 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:28.870876 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:28.871432 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-af4ee142-f8cf-4a89-816c-39cda34d20e1 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.151241 Sep 26 10:44:28.871549 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:28.871892 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 536/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:28 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:28.878635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:28.879664 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:28.880100 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:28.880787 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:28.881334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:28.881767 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:29.023245 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:29.030895 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-5772f4d7-f660-47b1-8a76-55b2b951fdc6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.164575 Sep 26 10:44:29.031457 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 496/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:28 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:44:29.895907 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:29.896517 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:29.902888 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:29.903365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:29.903793 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:29.904503 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:29.904950 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:29.905371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:30.032874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:30.041189 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-07add38d-8053-4313-a9cf-b9062dca8ef0 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1575 microversion: 2.1 time: 0.149737 Sep 26 10:44:30.041739 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 537/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:29 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:30.052577 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:30.053188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:30.059582 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:30.060004 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:30.060435 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:30.061117 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:30.061572 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:30.062002 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:30.192977 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:30.200485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-63be411e-a7af-4a20-897c-e9f395052a8a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.151761 Sep 26 10:44:30.201059 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 497/1034] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:30 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:31.064340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:31.064891 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:31.071970 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:31.072462 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:31.072930 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:31.073626 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:31.074104 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:31.074648 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:31.202372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:31.210798 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b7eee202-47f5-4f20-9421-341742d1c4ca tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1562 microversion: 2.1 time: 0.150462 Sep 26 10:44:31.211372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 538/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:31 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1562 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:44:31.223544 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:31.224220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:31.230907 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:31.231399 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:31.231838 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:31.232536 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:31.232991 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:31.233425 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:31.366553 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:31.374122 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2ee56d65-635c-48d3-9070-3c1b06be173a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.154368 Sep 26 10:44:31.374711 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 498/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:31 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:32.398341 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:32.398959 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:32.405340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:32.405826 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:32.406302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:32.406993 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:32.407451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:32.407881 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:32.537115 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:32.545201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-25b07e21-acb2-4941-acc8-4c3473b50b59 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.151379 Sep 26 10:44:32.545791 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 539/1037] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:32 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:33.567158 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:33.567714 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:33.574143 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:33.574629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:33.575069 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:33.575759 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:33.576220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:33.576672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:33.714298 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:33.722144 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-45e82500-895e-4054-9749-359b1c863c3c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.158924 Sep 26 10:44:33.723359 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 499/1038] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:33 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:33.774527 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-4e16e5b6-b213-4f6c-9a5f-f360aae44425 req-cb1336e2-e71e-4200-83c6-0a5aa9fa141e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "name": "network-vif-plugged", "status": "completed", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:33.785977 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4e16e5b6-b213-4f6c-9a5f-f360aae44425 req-cb1336e2-e71e-4200-83c6-0a5aa9fa141e service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:33.786487 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4e16e5b6-b213-4f6c-9a5f-f360aae44425 req-cb1336e2-e71e-4200-83c6-0a5aa9fa141e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:33.786955 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-4e16e5b6-b213-4f6c-9a5f-f360aae44425 req-cb1336e2-e71e-4200-83c6-0a5aa9fa141e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:33.801135 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-4e16e5b6-b213-4f6c-9a5f-f360aae44425 req-cb1336e2-e71e-4200-83c6-0a5aa9fa141e service nova] Creating event network-vif-plugged:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:44:33.807001 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-4e16e5b6-b213-4f6c-9a5f-f360aae44425 req-cb1336e2-e71e-4200-83c6-0a5aa9fa141e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036096 Sep 26 10:44:33.808297 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 540/1039] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:44:34.746220 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:34.746870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:34.748668 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:34.749325 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=6 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:34.755881 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:34.756363 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:34.756799 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:34.757488 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:34.757940 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:34.758389 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:34.889556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:34.897264 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-2f15a8db-c0ae-4516-8b40-cccb43856941 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.154976 Sep 26 10:44:34.897855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 500/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:34 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:35.917298 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:35.921934 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:35.922662 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:35.924405 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:35.930738 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:35.931225 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:35.931665 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:35.932359 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:35.932816 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:35.933243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:36.066224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:36.073841 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-0e521e38-4e56-447d-8308-3d411ced582a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.157608 Sep 26 10:44:36.078430 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 541/1041] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:35 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:37.097250 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:37.097803 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:37.100148 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:44:37.105593 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:37.106096 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:37.106532 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:37.107213 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:37.107666 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:37.108087 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:37.243058 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:37.250570 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-9059b480-8f0e-460e-bfd5-8a1e7b5c2db1 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.157259 Sep 26 10:44:37.251134 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 501/1042] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:37 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:37.790106 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-278d4e8a-bde2-412f-b60d-17583de14160 req-37ea1346-4a34-44f0-abaa-55211f40113f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37138afb-0a09-496d-8ad4-b1f3039ada7f", "name": "network-vif-plugged", "status": "completed", "tag": "68985c50-cfe2-4ac1-96af-9ccabd306e86"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:37.802331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-278d4e8a-bde2-412f-b60d-17583de14160 req-37ea1346-4a34-44f0-abaa-55211f40113f service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:37.802331 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-278d4e8a-bde2-412f-b60d-17583de14160 req-37ea1346-4a34-44f0-abaa-55211f40113f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:37.803146 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-278d4e8a-bde2-412f-b60d-17583de14160 req-37ea1346-4a34-44f0-abaa-55211f40113f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:37.813979 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-278d4e8a-bde2-412f-b60d-17583de14160 req-37ea1346-4a34-44f0-abaa-55211f40113f service nova] Creating event network-vif-plugged:68985c50-cfe2-4ac1-96af-9ccabd306e86 for instance 37138afb-0a09-496d-8ad4-b1f3039ada7f on hv-cinder-84456 Sep 26 10:44:37.819492 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-278d4e8a-bde2-412f-b60d-17583de14160 req-37ea1346-4a34-44f0-abaa-55211f40113f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033125 Sep 26 10:44:37.820097 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 542/1043] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:44:38.272731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:38.273338 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:38.279358 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:38.279840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:38.280269 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:38.280952 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:38.281399 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:38.281820 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:38.414481 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:38.422075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-b6fc6e3e-9c89-4f71-8a2a-6130d501660b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1265 microversion: 2.1 time: 0.153264 Sep 26 10:44:38.422635 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 502/1044] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:38 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:39.446834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:39.447572 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:39.453697 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:39.454222 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:39.454749 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:39.455380 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:39.455827 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:39.456257 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:39.592210 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:39.600091 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-4e2a41ae-f8f3-498c-a0a8-b00fbddda244 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1451 microversion: 2.1 time: 0.158077 Sep 26 10:44:39.600657 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 543/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:39 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:39.622884 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:44:39.623504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:44:39.630734 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:39.631431 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:39.631908 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:39.632715 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:39.633258 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:39.633702 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:39.768057 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:44:39.775776 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-41827ce5-d1ae-470c-85a7-d5189ef1e7b6 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1451 microversion: 2.1 time: 0.156741 Sep 26 10:44:39.776347 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 503/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:44:39 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:44:41.649349 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-1003f3d2-4f57-47f2-922f-ea97087f2709 req-3bf9b0c0-4bd9-4913-a319-608e8a6a6d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37138afb-0a09-496d-8ad4-b1f3039ada7f", "tag": "68985c50-cfe2-4ac1-96af-9ccabd306e86"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:44:41.658894 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1003f3d2-4f57-47f2-922f-ea97087f2709 req-3bf9b0c0-4bd9-4913-a319-608e8a6a6d9e service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:44:41.659371 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1003f3d2-4f57-47f2-922f-ea97087f2709 req-3bf9b0c0-4bd9-4913-a319-608e8a6a6d9e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:44:41.659802 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1003f3d2-4f57-47f2-922f-ea97087f2709 req-3bf9b0c0-4bd9-4913-a319-608e8a6a6d9e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:44:41.670845 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-1003f3d2-4f57-47f2-922f-ea97087f2709 req-3bf9b0c0-4bd9-4913-a319-608e8a6a6d9e service nova] Creating event network-changed:68985c50-cfe2-4ac1-96af-9ccabd306e86 for instance 37138afb-0a09-496d-8ad4-b1f3039ada7f on hv-cinder-84456 Sep 26 10:44:41.675742 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-1003f3d2-4f57-47f2-922f-ea97087f2709 req-3bf9b0c0-4bd9-4913-a319-608e8a6a6d9e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087418 Sep 26 10:44:41.676329 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 544/1047] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:45:47.779696 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=5 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:47.780637 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=48 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:47.783367 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 10:45:47.783704 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Mon Sep 26 10:45:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c (ip 10.222.0.49) !!! Sep 26 10:45:47.783815 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=7 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:47.785506 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=62 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:45:47.790184 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:45:47.790696 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:45:47.797339 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-2686a7c9-cab8-470a-a9e5-d440fbb74ab5 req-1dd026e0-7697-48bd-965e-1c1b7d84f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:45:47.803658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:47.804145 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:47.804586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:47.805284 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:47.805735 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:47.806188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:47.814839 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2686a7c9-cab8-470a-a9e5-d440fbb74ab5 req-1dd026e0-7697-48bd-965e-1c1b7d84f8b1 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:47.815401 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2686a7c9-cab8-470a-a9e5-d440fbb74ab5 req-1dd026e0-7697-48bd-965e-1c1b7d84f8b1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:47.815900 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-2686a7c9-cab8-470a-a9e5-d440fbb74ab5 req-1dd026e0-7697-48bd-965e-1c1b7d84f8b1 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:47.827255 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-2686a7c9-cab8-470a-a9e5-d440fbb74ab5 req-1dd026e0-7697-48bd-965e-1c1b7d84f8b1 service nova] Creating event network-changed:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:45:47.832379 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-2686a7c9-cab8-470a-a9e5-d440fbb74ab5 req-1dd026e0-7697-48bd-965e-1c1b7d84f8b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051353 Sep 26 10:45:47.832975 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 545/1048] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:45:47.836120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Going to try to terminate instance {{(pid=127055) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:45:47.925269 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-ba7c78b6-8fef-414d-b049-f46bc4a1c0c8 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 204 len: 0 microversion: 2.1 time: 0.147122 Sep 26 10:45:47.926894 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 504/1049] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:45:47 2022] DELETE /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:45:47.935562 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:45:47.936265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:45:47.946447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:47.948450 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:47.948980 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:47.949634 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:47.950437 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:47.952951 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:48.112262 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:45:48.120052 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-8a2153de-4835-4bcc-be9a-680f60455198 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.188685 Sep 26 10:45:48.120638 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 546/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:45:47 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:45:49.143555 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:45:49.144259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:45:49.150990 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:49.151471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:49.151906 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:49.152596 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:49.153049 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:49.153471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:49.389100 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:45:49.397731 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3dd8ec22-fd4d-4b87-8546-31797065e369 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1568 microversion: 2.1 time: 0.258364 Sep 26 10:45:49.398272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 505/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:45:49 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:45:50.300488 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-75a31685-cf3d-48c4-ad83-4dbaf0645ccc req-ce79ad8b-5c2c-4322-adb7-879d94d97a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae4f8b3-717f-4216-b14d-532a06968c8c", "name": "network-vif-deleted", "tag": "64a3f3c8-4cf7-45bf-9066-f13200377eeb"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:45:50.320243 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-75a31685-cf3d-48c4-ad83-4dbaf0645ccc req-ce79ad8b-5c2c-4322-adb7-879d94d97a8e service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:50.320641 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-75a31685-cf3d-48c4-ad83-4dbaf0645ccc req-ce79ad8b-5c2c-4322-adb7-879d94d97a8e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:50.321078 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-75a31685-cf3d-48c4-ad83-4dbaf0645ccc req-ce79ad8b-5c2c-4322-adb7-879d94d97a8e service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:50.334954 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-75a31685-cf3d-48c4-ad83-4dbaf0645ccc req-ce79ad8b-5c2c-4322-adb7-879d94d97a8e service nova] Creating event network-vif-deleted:64a3f3c8-4cf7-45bf-9066-f13200377eeb for instance 6ae4f8b3-717f-4216-b14d-532a06968c8c on hv-cinder-84456 Sep 26 10:45:50.339957 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-75a31685-cf3d-48c4-ad83-4dbaf0645ccc req-ce79ad8b-5c2c-4322-adb7-879d94d97a8e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043773 Sep 26 10:45:50.340904 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 547/1052] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:45:50.421120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:45:50.421741 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:45:50.428314 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:50.428824 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:50.429259 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:50.429952 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:50.430432 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:50.430854 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:50.515487 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1dcec4c0b364d7caa37af361da31b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35e6a97e32b426daab0ba663323e8a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:45:50.523972 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-03e06b97-6485-49ce-b0b0-f00220e68639 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 200 len: 1219 microversion: 2.1 time: 0.106771 Sep 26 10:45:50.524550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 506/1053] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:45:50 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:45:51.547365 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:45:51.548096 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] [instance: 6ae4f8b3-717f-4216-b14d-532a06968c8c] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:45:51.554698 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:51.555180 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:51.555616 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:51.556302 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:45:51.556757 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:45:51.557182 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:45:51.570139 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] HTTP exception thrown: Instance 6ae4f8b3-717f-4216-b14d-532a06968c8c could not be found. Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Request method failure captured: Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c HTTP/1.1 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYHWNMTNMHqVThQ3PUdv2ZrTIzdLhQ2nTvEC3rrmxWF2UZZHUNe_ZDbLIoJ4wxc9Azql_MagzyePTKsY3fo3HgBcts-kCdF04eKoPacjrLF3VVZBm0nSPkpggFZL8kzeGeKd-Yxxmt5yfxeKFpKAvRdjP2cmr1GzB8d7kAQn1uQiLN8 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: b35e6a97e32b426daab0ba663323e8a8 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-TestShelveInstance-1851747258 Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:45:51.571760 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b35e6a97e32b426daab0ba663323e8a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b35e6a97e32b426daab0ba663323e8a8", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b35e6a97e32b426daab0ba663323e8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b35e6a97e32b426daab0ba663323e8a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-TestShelveInstance-1851747258 Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: b35e6a97e32b426daab0ba663323e8a8 Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-TestShelveInstance-1851747258 Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-TestShelveInstance-1851747258-project Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: c1dcec4c0b364d7caa37af361da31b18 Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-TestShelveInstance-1851747258-project Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 6ae4f8b3-717f-4216-b14d-532a06968c8c could not be found. Sep 26 10:45:51.573593 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '6ae4f8b3-717f-4216-b14d-532a06968c8c'} Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae4f8b3-717f-4216-b14d-532a06968c8c could not be found. Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:45:51.574639 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae4f8b3-717f-4216-b14d-532a06968c8c could not be found. Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae4f8b3-717f-4216-b14d-532a06968c8c could not be found. Sep 26 10:45:51.576285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:45:51.577830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Returning 404 to user: Instance 6ae4f8b3-717f-4216-b14d-532a06968c8c could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:45:51.577830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-03e7691e-8ce3-4c98-b77e-a12017b099b2 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c" status: 404 len: 111 microversion: 2.1 time: 0.029989 Sep 26 10:45:51.577830 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 548/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:45:51 2022] GET /compute/v2.1/servers/6ae4f8b3-717f-4216-b14d-532a06968c8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:45:51.736504 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7eaac3db-bcf0-4b2a-b049-4e2bd27e5339 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] Calling method '.version_select at 0x7fbadaf66550>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:45:51.760919 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7eaac3db-bcf0-4b2a-b049-4e2bd27e5339 tempest-TestShelveInstance-1851747258 tempest-TestShelveInstance-1851747258-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1814152384" status: 202 len: 0 microversion: 2.1 time: 0.028587 Sep 26 10:45:51.761516 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 507/1055] 10.222.0.49 () {58 vars in 1254 bytes} [Mon Sep 26 10:45:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1814152384 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 26 10:46:17.192899 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1020317907", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-906365057", "security_groups": [{"name": "tempest-secgroup-smoke-1388718423"}], "block_device_mapping_v2": [{"uuid": "10f9308d-53a5-4def-abc9-08b8c702e667", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "590c7da6-7b88-4882-abbb-133a0426748c"}]}} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:46:17.203340 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=8 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:17.203986 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=12 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:17.307605 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.network.neutron [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] validate_networks() for [('590c7da6-7b88-4882-abbb-133a0426748c', None, None, None, None, None)] {{(pid=127056) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 26 10:46:17.776829 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Flavor limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 26 10:46:17.777250 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Image limits 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 26 10:46:17.777717 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Flavor pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 26 10:46:17.778156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Image pref 0:0:0 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 26 10:46:17.778569 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.virt.hardware [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127056) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 26 10:46:17.787195 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:17.787678 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:17.788112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:17.788836 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:17.789289 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:17.789711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:17.807038 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 26 10:46:17.811012 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.quota [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Getting quotas for user 0561a33fd6984118b1fd221f9eaaeef6 and project 1e0f8c6af4d3456c9d700088cd8f5eb5. Resources: {'ram', 'cores', 'instances'} {{(pid=127056) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 26 10:46:17.867479 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Going to run 1 instances... {{(pid=127056) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 26 10:46:17.869578 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10f9308d-53a5-4def-abc9-08b8c702e667',volume_size=None,volume_type=None)] {{(pid=127056) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 26 10:46:18.007204 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-b534b20c-ad47-49dc-95cb-62888611f79f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818286 Sep 26 10:46:18.007862 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 549/1056] 10.222.0.49 () {60 vars in 1147 bytes} [Mon Sep 26 10:46:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 26 10:46:18.019319 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c22a3821-bb5d-4558-9819-63b9751baf94 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:18.020075 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c22a3821-bb5d-4558-9819-63b9751baf94 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:18.024670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:18.025553 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:18.080337 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-c22a3821-bb5d-4558-9819-63b9751baf94 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:18.087795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c22a3821-bb5d-4558-9819-63b9751baf94 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1094 microversion: 2.1 time: 0.072486 Sep 26 10:46:18.088351 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 508/1057] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:18 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:19.111499 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:19.112080 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:19.118489 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:19.118978 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:19.119421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:19.120269 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:19.120735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:19.121164 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:19.197568 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:19.209021 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-759cd15b-7d54-48d0-bacd-2ffc0b1b49af tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1200 microversion: 2.1 time: 0.101789 Sep 26 10:46:19.209968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 550/1058] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:19 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:20.232658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:20.233681 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:20.241758 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:20.242451 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:20.243028 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:20.243678 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:20.244140 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:20.244575 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:20.490649 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:20.498840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-40d5b9bd-c839-4dc5-b1fa-2209be75d227 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.270301 Sep 26 10:46:20.499417 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 509/1059] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:20 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:20.629238 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-1987d3ec-5d40-4e06-bec2-45d168e3b339 req-91f316cc-854e-40fe-8bca-36b1764a5dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b2843b-5788-4cc5-a39e-001dd4d5d4d8", "tag": "1b1a8663-7987-4bcc-a12a-0e28699fafa9"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:46:20.641501 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1987d3ec-5d40-4e06-bec2-45d168e3b339 req-91f316cc-854e-40fe-8bca-36b1764a5dc8 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:20.642123 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1987d3ec-5d40-4e06-bec2-45d168e3b339 req-91f316cc-854e-40fe-8bca-36b1764a5dc8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:20.643265 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-1987d3ec-5d40-4e06-bec2-45d168e3b339 req-91f316cc-854e-40fe-8bca-36b1764a5dc8 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:20.655658 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-1987d3ec-5d40-4e06-bec2-45d168e3b339 req-91f316cc-854e-40fe-8bca-36b1764a5dc8 service nova] Creating event network-changed:1b1a8663-7987-4bcc-a12a-0e28699fafa9 for instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 on hv-cinder-84456 Sep 26 10:46:20.661174 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-1987d3ec-5d40-4e06-bec2-45d168e3b339 req-91f316cc-854e-40fe-8bca-36b1764a5dc8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035636 Sep 26 10:46:20.661775 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 551/1060] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:46:21.522221 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:21.522840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:21.529403 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:21.529884 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:21.530352 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:21.531042 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:21.531497 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:21.531914 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:21.754157 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:21.762136 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-8ba45ef8-4a87-49ad-a0eb-30feabfcf700 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.243843 Sep 26 10:46:21.762716 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 510/1061] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:21 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:22.785973 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:22.786718 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:22.792913 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:22.793407 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:22.793848 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:22.794656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:22.795112 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:22.795540 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:22.927882 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:22.935588 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-59b605f8-e9cf-4bc7-a934-9082e18c6ff2 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.154311 Sep 26 10:46:22.936148 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 552/1062] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:22 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:23.958502 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:23.959112 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:23.965375 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:23.965855 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:23.966334 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:23.967019 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:23.967471 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:23.967892 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:24.100455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:24.108498 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-bf84beda-eb96-4cb7-9c69-4a0154970df8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.154387 Sep 26 10:46:24.109104 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 511/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:23 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:25.131310 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:25.131889 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:25.138143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:25.138627 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:25.139084 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:25.139765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:25.140247 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:25.140667 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:25.268020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:25.276223 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-27574545-6439-4e54-bd4f-d969988f87aa tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.148881 Sep 26 10:46:25.276781 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 553/1064] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:25 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:26.298780 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:26.299382 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:26.306629 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:26.307158 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:26.307591 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:26.308307 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:26.308756 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:26.309198 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:26.437949 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:26.445586 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-261cd562-6126-48b3-b2c1-f0266a6e348c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.150656 Sep 26 10:46:26.446176 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 512/1065] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:26 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:27.468704 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:27.469285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:27.476249 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:27.476730 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:27.477166 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:27.477850 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:27.478335 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:27.478758 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:27.608402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:27.616006 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-05d040e3-31c6-4de5-bf3c-48a916a21e9a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.151356 Sep 26 10:46:27.616564 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 554/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:27 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:28.641145 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:28.641703 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:28.644317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell0:SELECT=2 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:28.649670 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:28.650188 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:28.650628 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:28.651326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:28.651774 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:28.652219 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:28.786839 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:28.794591 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-3eb1d207-6a30-4e0f-b1bd-985e3db6fe46 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.158069 Sep 26 10:46:28.795160 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 513/1067] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:28 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:29.817201 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:29.817818 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:29.819807 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=2 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:29.820467 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell0:SELECT=6 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:46:29.827073 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:29.827558 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:29.827995 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:29.828687 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:29.829143 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:29.829571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:29.962248 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:29.969821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-22531f0a-3b2f-4241-9e5b-674b56ead85c tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.156511 Sep 26 10:46:29.970420 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 555/1068] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:29 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:30.261872 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-e91f694a-afaf-4270-89f3-d7d52d99cac3 req-2b426343-147e-4d7b-a5dd-2ac54c35607a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b2843b-5788-4cc5-a39e-001dd4d5d4d8", "name": "network-vif-plugged", "status": "completed", "tag": "1b1a8663-7987-4bcc-a12a-0e28699fafa9"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:46:30.273078 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e91f694a-afaf-4270-89f3-d7d52d99cac3 req-2b426343-147e-4d7b-a5dd-2ac54c35607a service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:30.273554 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e91f694a-afaf-4270-89f3-d7d52d99cac3 req-2b426343-147e-4d7b-a5dd-2ac54c35607a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:30.273974 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-e91f694a-afaf-4270-89f3-d7d52d99cac3 req-2b426343-147e-4d7b-a5dd-2ac54c35607a service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:30.284810 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-e91f694a-afaf-4270-89f3-d7d52d99cac3 req-2b426343-147e-4d7b-a5dd-2ac54c35607a service nova] Creating event network-vif-plugged:1b1a8663-7987-4bcc-a12a-0e28699fafa9 for instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 on hv-cinder-84456 Sep 26 10:46:30.289763 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-e91f694a-afaf-4270-89f3-d7d52d99cac3 req-2b426343-147e-4d7b-a5dd-2ac54c35607a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031607 Sep 26 10:46:30.290566 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 514/1069] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:46:30.993968 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:30.994609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:31.000939 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:31.001398 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:31.001834 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:31.002545 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:31.003026 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:31.003451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:31.139156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:31.147360 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7d2d5267-d889-45a2-891a-77eda8f9fe92 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1266 microversion: 2.1 time: 0.157291 Sep 26 10:46:31.147926 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 556/1070] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:30 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:46:32.170937 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:32.171540 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:32.177728 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:32.178256 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:32.178695 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:32.179386 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:32.179840 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:32.180265 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:32.309385 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:32.317562 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-71ce2dd5-b252-4cef-891d-dbde6c171586 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1453 microversion: 2.1 time: 0.151558 Sep 26 10:46:32.318152 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 515/1071] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:32 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:32.340142 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:46:32.340788 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:46:32.347212 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:32.347694 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:32.348135 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:32.348824 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:32.349288 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:32.349731 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:32.478992 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:46:32.486874 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-f9f8e841-d730-4611-9cfd-85e626c00738 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1453 microversion: 2.1 time: 0.150659 Sep 26 10:46:32.487446 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 557/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:46:32 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:46:34.294463 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-9186a623-ef65-4ae8-b0f3-3ba936b1e9c1 req-986cf42c-ba0e-4890-8422-762d5e748d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b2843b-5788-4cc5-a39e-001dd4d5d4d8", "tag": "1b1a8663-7987-4bcc-a12a-0e28699fafa9"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:46:34.304072 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-9186a623-ef65-4ae8-b0f3-3ba936b1e9c1 req-986cf42c-ba0e-4890-8422-762d5e748d24 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:46:34.304558 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-9186a623-ef65-4ae8-b0f3-3ba936b1e9c1 req-986cf42c-ba0e-4890-8422-762d5e748d24 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:46:34.304996 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-9186a623-ef65-4ae8-b0f3-3ba936b1e9c1 req-986cf42c-ba0e-4890-8422-762d5e748d24 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:46:34.316054 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-9186a623-ef65-4ae8-b0f3-3ba936b1e9c1 req-986cf42c-ba0e-4890-8422-762d5e748d24 service nova] Creating event network-changed:1b1a8663-7987-4bcc-a12a-0e28699fafa9 for instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 on hv-cinder-84456 Sep 26 10:46:34.321123 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-9186a623-ef65-4ae8-b0f3-3ba936b1e9c1 req-986cf42c-ba0e-4890-8422-762d5e748d24 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030348 Sep 26 10:46:34.321992 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 516/1073] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:48:14.394801 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:48:14.395557 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG dbcounter [-] [127056] Writing DB stats nova_cell1:SELECT=46 {{(pid=127056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:48:14.396947 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 10:48:14.397100 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Mon Sep 26 10:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 (ip 10.222.0.49) !!! Sep 26 10:48:14.400831 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR oslo.messaging._drivers.impl_rabbit [-] [38405daf-6dd1-4766-8189-a95519ec6e73] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 26 10:48:14.401495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_api:SELECT=20 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:48:14.402396 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG dbcounter [-] [127055] Writing DB stats nova_cell1:SELECT=40 {{(pid=127055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 10:48:14.402711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:14.403020 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:14.404556 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 26 10:48:14.404781 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Mon Sep 26 10:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.49) !!! Sep 26 10:48:14.417893 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-76cfe7f7-be11-4488-bbb4-b8b6b32d5824 req-fe2c8064-18c9-4dd2-9dd7-34692e781aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b2843b-5788-4cc5-a39e-001dd4d5d4d8", "tag": "1b1a8663-7987-4bcc-a12a-0e28699fafa9"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:48:14.421707 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:14.422426 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:14.423040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:14.423808 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:14.424360 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:14.424693 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:14.430141 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-76cfe7f7-be11-4488-bbb4-b8b6b32d5824 req-fe2c8064-18c9-4dd2-9dd7-34692e781aa0 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:14.430623 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-76cfe7f7-be11-4488-bbb4-b8b6b32d5824 req-fe2c8064-18c9-4dd2-9dd7-34692e781aa0 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:14.431050 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-76cfe7f7-be11-4488-bbb4-b8b6b32d5824 req-fe2c8064-18c9-4dd2-9dd7-34692e781aa0 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:14.442475 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-76cfe7f7-be11-4488-bbb4-b8b6b32d5824 req-fe2c8064-18c9-4dd2-9dd7-34692e781aa0 service nova] Creating event network-changed:1b1a8663-7987-4bcc-a12a-0e28699fafa9 for instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 on hv-cinder-84456 Sep 26 10:48:14.449095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-76cfe7f7-be11-4488-bbb4-b8b6b32d5824 req-fe2c8064-18c9-4dd2-9dd7-34692e781aa0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052171 Sep 26 10:48:14.449696 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 517/1074] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:48:14.458920 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:48:14.551689 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-6ef156d6-c02d-4081-83f6-c34ee3070822 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 204 len: 0 microversion: 2.1 time: 0.158347 Sep 26 10:48:14.552402 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 558/1075] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:48:14 2022] DELETE /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:48:14.565484 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:14.566390 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:14.573948 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:14.575020 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:14.575652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:14.576455 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:14.577035 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:14.577550 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:14.736966 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:48:14.744856 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-89d93661-a731-4c97-be06-75afe33f8950 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1578 microversion: 2.1 time: 0.186462 Sep 26 10:48:14.745422 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 518/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:14 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:48:15.768772 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:15.769473 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:15.776711 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:15.777224 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:15.777656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:15.778372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:15.778823 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:15.779253 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:15.942722 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:48:15.951196 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-d1680ba5-9935-4614-91cf-aca07b16a312 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1578 microversion: 2.1 time: 0.186784 Sep 26 10:48:15.966234 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 559/1077] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:15 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:48:16.975413 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:16.976084 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:16.987773 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO oslo.messaging._drivers.impl_rabbit [-] [38405daf-6dd1-4766-8189-a95519ec6e73] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42498. Sep 26 10:48:16.991922 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:16.992411 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:16.992841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:16.993901 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:16.994415 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:16.994841 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:17.055066 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [req-81ac5c70-e404-4d39-967f-d22970fcd5ce req-abda6c9d-4b80-483a-a178-dc77f74fd36f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b2843b-5788-4cc5-a39e-001dd4d5d4d8", "name": "network-vif-deleted", "tag": "1b1a8663-7987-4bcc-a12a-0e28699fafa9"}]} {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:48:17.062783 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:48:17.069429 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-81ac5c70-e404-4d39-967f-d22970fcd5ce req-abda6c9d-4b80-483a-a178-dc77f74fd36f service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:17.070493 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-81ac5c70-e404-4d39-967f-d22970fcd5ce req-abda6c9d-4b80-483a-a178-dc77f74fd36f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:17.071162 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [req-81ac5c70-e404-4d39-967f-d22970fcd5ce req-abda6c9d-4b80-483a-a178-dc77f74fd36f service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:17.082364 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-d17ba029-ac93-40f6-83f3-b60b53cab766 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 200 len: 1391 microversion: 2.1 time: 0.110685 Sep 26 10:48:17.083211 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 519/1078] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:16 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 1391 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:48:17.088421 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.compute.server_external_events [req-81ac5c70-e404-4d39-967f-d22970fcd5ce req-abda6c9d-4b80-483a-a178-dc77f74fd36f service nova] Creating event network-vif-deleted:1b1a8663-7987-4bcc-a12a-0e28699fafa9 for instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 on hv-cinder-84456 Sep 26 10:48:17.094565 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [req-81ac5c70-e404-4d39-967f-d22970fcd5ce req-abda6c9d-4b80-483a-a178-dc77f74fd36f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043200 Sep 26 10:48:17.095725 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 560/1079] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 26 10:48:18.108095 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:18.108667 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: c1b2843b-5788-4cc5-a39e-001dd4d5d4d8] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:18.115126 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:18.115609 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:18.116044 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:18.116790 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:18.117277 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:18.117706 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:18.130809 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] HTTP exception thrown: Instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 could not be found. Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Request method failure captured: Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 HTTP/1.1 Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYHk-wynvkyn-EP_LGdfpf_NCtXzaJCLY04mD7Ftj_qY4axhOeTRuTDHFae5PpOxkjDHePMALvwg4a2Ke7BgjBUPCzrrIU-IQhYl8if5YKDRZymLrBswtk4ENSr-rlZXWOE2xlGJNT39U7-_1c74klXva0CjReSb4eHdi0Ptlh3e7YA Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:48:18.134813 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1e0f8c6af4d3456c9d700088cd8f5eb5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 0561a33fd6984118b1fd221f9eaaeef6 Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 could not be found. Sep 26 10:48:18.136768 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': 'c1b2843b-5788-4cc5-a39e-001dd4d5d4d8'} Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 could not be found. Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:48:18.137795 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 could not be found. Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 could not be found. Sep 26 10:48:18.139495 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:18.141073 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Returning 404 to user: Instance c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:48:18.141073 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-7c565675-0432-41ae-a240-242d6035ed4b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8" status: 404 len: 111 microversion: 2.1 time: 0.032359 Sep 26 10:48:18.141073 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 520/1080] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:18 2022] GET /compute/v2.1/servers/c1b2843b-5788-4cc5-a39e-001dd4d5d4d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:48:21.200586 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:21.201497 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:21.201866 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-59b89c82-7316-4568-a5b9-9f976728e4a1 req-145d0c1e-5927-468e-92d8-a1d3dd2126ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37138afb-0a09-496d-8ad4-b1f3039ada7f", "tag": "68985c50-cfe2-4ac1-96af-9ccabd306e86"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:48:21.208514 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:21.209090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:21.209637 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:21.210632 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:21.211156 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:21.211426 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-59b89c82-7316-4568-a5b9-9f976728e4a1 req-145d0c1e-5927-468e-92d8-a1d3dd2126ba service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:21.211906 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:21.212033 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-59b89c82-7316-4568-a5b9-9f976728e4a1 req-145d0c1e-5927-468e-92d8-a1d3dd2126ba service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:21.212336 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-59b89c82-7316-4568-a5b9-9f976728e4a1 req-145d0c1e-5927-468e-92d8-a1d3dd2126ba service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:21.223588 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-59b89c82-7316-4568-a5b9-9f976728e4a1 req-145d0c1e-5927-468e-92d8-a1d3dd2126ba service nova] Creating event network-changed:68985c50-cfe2-4ac1-96af-9ccabd306e86 for instance 37138afb-0a09-496d-8ad4-b1f3039ada7f on hv-cinder-84456 Sep 26 10:48:21.228962 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-59b89c82-7316-4568-a5b9-9f976728e4a1 req-145d0c1e-5927-468e-92d8-a1d3dd2126ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030770 Sep 26 10:48:21.230100 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 521/1081] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:48:21.238671 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Going to try to terminate instance {{(pid=127056) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 26 10:48:21.329090 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-fa4fdf6e-3cfc-4549-8672-d2edda2963f8 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "DELETE /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 204 len: 0 microversion: 2.1 time: 0.132700 Sep 26 10:48:21.333040 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 561/1082] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:48:21 2022] DELETE /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 26 10:48:21.340600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:21.341326 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:21.347826 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:21.348324 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:21.348912 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:21.349705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:21.350200 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:21.351418 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:21.492608 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.policy [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127055) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:48:21.500493 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-cdf0475a-a943-47c9-9564-9f3e65cb4c0a tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1576 microversion: 2.1 time: 0.165665 Sep 26 10:48:21.501094 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 522/1083] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:21 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 26 10:48:22.526740 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:22.527451 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:22.533901 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:22.534419 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:22.534856 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:22.535551 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:22.536004 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:22.536511 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:22.672392 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:48:22.680886 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-e723c370-0511-4cb8-bae4-5216945455de tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1576 microversion: 2.1 time: 0.159284 Sep 26 10:48:22.681447 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 562/1084] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:22 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:48:23.501014 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [req-d41e6c15-1e31-4aba-bccc-ee62ebfee548 req-514a7892-b10f-4ed7-8f05-d22e51272bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37138afb-0a09-496d-8ad4-b1f3039ada7f", "name": "network-vif-deleted", "tag": "68985c50-cfe2-4ac1-96af-9ccabd306e86"}]} {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 26 10:48:23.511993 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-d41e6c15-1e31-4aba-bccc-ee62ebfee548 req-514a7892-b10f-4ed7-8f05-d22e51272bd5 service nova] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:23.512460 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-d41e6c15-1e31-4aba-bccc-ee62ebfee548 req-514a7892-b10f-4ed7-8f05-d22e51272bd5 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:23.512964 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [req-d41e6c15-1e31-4aba-bccc-ee62ebfee548 req-514a7892-b10f-4ed7-8f05-d22e51272bd5 service nova] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:23.524870 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.compute.server_external_events [req-d41e6c15-1e31-4aba-bccc-ee62ebfee548 req-514a7892-b10f-4ed7-8f05-d22e51272bd5 service nova] Creating event network-vif-deleted:68985c50-cfe2-4ac1-96af-9ccabd306e86 for instance 37138afb-0a09-496d-8ad4-b1f3039ada7f on hv-cinder-84456 Sep 26 10:48:23.530097 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [req-d41e6c15-1e31-4aba-bccc-ee62ebfee548 req-514a7892-b10f-4ed7-8f05-d22e51272bd5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032737 Sep 26 10:48:23.530705 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 523/1085] 10.222.0.49 () {64 vars in 1317 bytes} [Mon Sep 26 10:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 26 10:48:23.705821 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:23.706571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:23.713141 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:23.713571 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:23.714008 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:23.714735 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:23.715188 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:23.715618 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:23.782609 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.policy [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0561a33fd6984118b1fd221f9eaaeef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0f8c6af4d3456c9d700088cd8f5eb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127056) authorize /opt/stack/nova/nova/policy.py:199}} Sep 26 10:48:23.791134 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-1b61e720-3038-4637-8929-671275c8169f tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 200 len: 1224 microversion: 2.1 time: 0.089874 Sep 26 10:48:23.791719 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 563/1086] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:23 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 26 10:48:24.817317 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:24.818039 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 37138afb-0a09-496d-8ad4-b1f3039ada7f] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:24.824742 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:24.825232 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:24.825672 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:24.826394 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:24.826858 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:24.827289 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:24.841120 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] HTTP exception thrown: Instance 37138afb-0a09-496d-8ad4-b1f3039ada7f could not be found. Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Request method failure captured: Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f HTTP/1.1 Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYHk-wynvkyn-EP_LGdfpf_NCtXzaJCLY04mD7Ftj_qY4axhOeTRuTDHFae5PpOxkjDHePMALvwg4a2Ke7BgjBUPCzrrIU-IQhYl8if5YKDRZymLrBswtk4ENSr-rlZXWOE2xlGJNT39U7-_1c74klXva0CjReSb4eHdi0Ptlh3e7YA Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:48:24.842762 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1e0f8c6af4d3456c9d700088cd8f5eb5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 0561a33fd6984118b1fd221f9eaaeef6 Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 37138afb-0a09-496d-8ad4-b1f3039ada7f could not be found. Sep 26 10:48:24.844600 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '37138afb-0a09-496d-8ad4-b1f3039ada7f'} Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37138afb-0a09-496d-8ad4-b1f3039ada7f could not be found. Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:48:24.845581 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37138afb-0a09-496d-8ad4-b1f3039ada7f could not be found. Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37138afb-0a09-496d-8ad4-b1f3039ada7f could not be found. Sep 26 10:48:24.847214 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:24.848658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Returning 404 to user: Instance 37138afb-0a09-496d-8ad4-b1f3039ada7f could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:48:24.848658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-27d34498-a42c-4c3b-a2ec-e64e93e6c203 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f" status: 404 len: 111 microversion: 2.1 time: 0.031687 Sep 26 10:48:24.848658 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 524/1087] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:24 2022] GET /compute/v2.1/servers/37138afb-0a09-496d-8ad4-b1f3039ada7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:48:25.282782 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:25.283286 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.compute.api [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127056) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:25.290285 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:25.290765 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:25.291197 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:25.291879 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:25.292324 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:25.292741 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG oslo_concurrency.lockutils [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:25.308942 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.wsgi [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] HTTP exception thrown: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Request method failure captured: Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: request: DELETE /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 HTTP/1.1 Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept: application/json Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Accept-Encoding: identity Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Connection: close Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Length: 0 Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Content-Type: application/json Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Host: 10.222.0.49 Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: Openstack-System-Scope: None Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: User-Agent: python-urllib3/1.26.12 Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Auth-Token: gAAAAABjMYHk-wynvkyn-EP_LGdfpf_NCtXzaJCLY04mD7Ftj_qY4axhOeTRuTDHFae5PpOxkjDHePMALvwg4a2Ke7BgjBUPCzrrIU-IQhYl8if5YKDRZymLrBswtk4ENSr-rlZXWOE2xlGJNT39U7-_1c74klXva0CjReSb4eHdi0Ptlh3e7YA Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Id: None Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Domain-Name: None Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Identity-Status: Confirmed Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Is-Admin-Project: True Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Id: default Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Domain-Name: Default Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Project-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Role: reader,member Sep 26 10:48:25.310602 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Roles: reader,member Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1e0f8c6af4d3456c9d700088cd8f5eb5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-Tenant-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Id: default Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Domain-Name: Default Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Id: 0561a33fd6984118b1fd221f9eaaeef6 Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: X-User-Name: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: method: > Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: exception: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.312372 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: action_args: {'id': '76698be8-9cd8-48af-8dac-1f621de79411'} Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:48:25.313218 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.314656 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.316059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Returning 404 to user: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. {{(pid=127056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:48:25.316059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-7e7c9f1d-d003-445b-93d4-24f6a5dc90b0 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 404 len: 111 microversion: 2.1 time: 0.033092 Sep 26 10:48:25.316059 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 564/1088] 10.222.0.49 () {58 vars in 1239 bytes} [Mon Sep 26 10:48:25 2022] DELETE /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:48:25.320652 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '>' {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:25.321292 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.compute.api [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] [instance: 76698be8-9cd8-48af-8dac-1f621de79411] Fetching instance by UUID {{(pid=127055) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 26 10:48:25.327272 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:25.327779 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:25.328205 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:25.328897 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Acquiring lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 26 10:48:25.329356 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 26 10:48:25.329784 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG oslo_concurrency.lockutils [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Lock "e066cc03-4cbd-4f04-8c08-1a760e88bbb8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 26 10:48:25.342981 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.wsgi [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] HTTP exception thrown: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Request method failure captured: Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: request: GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 HTTP/1.1 Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept: application/json Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Accept-Encoding: identity Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Connection: close Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Length: 0 Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Content-Type: application/json Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Host: 10.222.0.49 Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: Openstack-System-Scope: None Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: User-Agent: python-urllib3/1.26.12 Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Auth-Token: gAAAAABjMYHk-wynvkyn-EP_LGdfpf_NCtXzaJCLY04mD7Ftj_qY4axhOeTRuTDHFae5PpOxkjDHePMALvwg4a2Ke7BgjBUPCzrrIU-IQhYl8if5YKDRZymLrBswtk4ENSr-rlZXWOE2xlGJNT39U7-_1c74klXva0CjReSb4eHdi0Ptlh3e7YA Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Id: None Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Domain-Name: None Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Identity-Status: Confirmed Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Is-Admin-Project: True Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Id: default Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Domain-Name: Default Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Project-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Role: reader,member Sep 26 10:48:25.344485 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Roles: reader,member Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1e0f8c6af4d3456c9d700088cd8f5eb5", "adminURL": "http://10.222.0.49:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1e0f8c6af4d3456c9d700088cd8f5eb5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}] Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Id: 1e0f8c6af4d3456c9d700088cd8f5eb5 Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-Tenant-Name: tempest-TestVolumeBootPattern-1415308900 Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Id: default Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Domain-Name: Default Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Id: 0561a33fd6984118b1fd221f9eaaeef6 Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: X-User-Name: tempest-TestVolumeBootPattern-1415308900-project Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: method: > Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: exception: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.346279 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: action_args: {'id': '76698be8-9cd8-48af-8dac-1f621de79411'} Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: {{(pid=127055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 26 10:48:25.347229 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. Sep 26 10:48:25.348899 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: ERROR nova.api.openstack.wsgi Sep 26 10:48:25.350439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: DEBUG nova.api.openstack.wsgi [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Returning 404 to user: Instance 76698be8-9cd8-48af-8dac-1f621de79411 could not be found. {{(pid=127055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 26 10:48:25.350439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: INFO nova.api.openstack.requestlog [None req-c9869ca7-2650-4372-813a-8bed8de1c18b tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411" status: 404 len: 111 microversion: 2.1 time: 0.029083 Sep 26 10:48:25.350439 dv-cinder-844563-7-iscsi devstack@n-api.service[127055]: [pid: 127055|app: 0|req: 525/1089] 10.222.0.49 () {58 vars in 1236 bytes} [Mon Sep 26 10:48:25 2022] GET /compute/v2.1/servers/76698be8-9cd8-48af-8dac-1f621de79411 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 26 10:48:26.641648 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: DEBUG nova.api.openstack.wsgi [None req-a04361ea-329b-49d1-9b89-e24b7b767d15 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] Calling method '.version_select at 0x7fbadb3f8820>' {{(pid=127056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 26 10:48:26.674045 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: INFO nova.api.openstack.requestlog [None req-a04361ea-329b-49d1-9b89-e24b7b767d15 tempest-TestVolumeBootPattern-1415308900 tempest-TestVolumeBootPattern-1415308900-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-906365057" status: 202 len: 0 microversion: 2.1 time: 0.036177 Sep 26 10:48:26.675264 dv-cinder-844563-7-iscsi devstack@n-api.service[127056]: [pid: 127056|app: 0|req: 565/1090] 10.222.0.49 () {58 vars in 1260 bytes} [Mon Sep 26 10:48:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-906365057 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)